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ABSTRACT 

This report analyzes what the Office of Technology 
Assessment (OTA) identifies as four pressing challenges for the 
Federal Research System m resource allocation and funding for 
research in the 1990s: (1) setting priorities m funding; (2) 
understanding trends m research expenditures; (3) preparing human 
resources for the future research work force; and (4) supplying 
appropriate data for ongoing research decisionmaking. Ad-iitionally , 
the report examines the Federal Research System: the executive and 
legislative branches and the research agencies. Also discussed are 
the value of science and the changing research economy. The report 
contains several appendices which include the following: major 
legislation enacted since 1975 affecting U.S. research and 
development; the top 100 institutions ranked by cunount of Federal 
research and development funding received for fiscal year 1989; the 
top 100 U.S. academic institutions ranked by Citation Impact, 
1981-88; and academic and basic research decisionmaking in other 
countries. A list of OTA workshop participants, reviewers, and 
contributors is provided. Contains an index and 604 references. 
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Foreword 



The Nation relies on federally funded research to addr< ss many national objectives. With 
global competition, changing student demographics, rising demands for research funds, and 
the prospect of constricted budgets. Congress and the executive branch must make difficult 
choices in supporting U.S. sci nee and engineering. The House Committee on Science, Space, 
and Technology asked OTA to examine the Federal research system—a conglomeration of 
many separate systems that sponsor, oversee, and perform research— and the challenees that 
it will face in the 1990s. 

Given the exceptional history, strength, and character of U.S. research, there will always 
be more opportunities than can be funded, more deserving researchers competing than can be 
suslajned, and more institutions seeking to expand than the prime sponsor— the Federal 
Govftrnment— can fund. Tlie objective for government, then, is to ensure continued fundihg 
for a full portfolio of Hrst-rate research and a high-caliber research work force to assure 
long-term scientific progress. This report analyzes what OTA idcnt nes as four pressing 
chaUenges for the research system in the 1990s: se'dng priorities in funding, understanding 
trends in research expenditures, preparing human resources for the future research work force, 
and supplying appropriate data for ongoing research decisionmaking. Managing the Federal 
research system requires more ihan funding; it means devising ways to retain the diversity and 
creativity that have distinguished U.S. contributions to scientific knowledge. 

The advisory panel, workshop participants, reviewers, and other contributors to this study 
were instnimental in defining the key issues and providing a range of perspectives on them. 
OTA thanks them for their commitment of energy and sense of purpose. Their participation 
does not necessarUy represent endorsement of the contents of this report, for which OTA bears 
sole responsibility. 
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CHAPTER 1 

Summary and Issues for Congress 



Introduction 

Research provides extraordinary benefits to soci* 
ety through the creation of new knowledge and the 
training of scientists and engineers. The research and 
higher education system in the United States is the 
envy of the world, and has a long history of 
advancing the state of scientific knowledge. This is 
known as "scientific progress"; "... not the mere 
accumulation of data and information, but rather the 
advancement of our codified understanding of the 
natural universe and of human behavior, social and 
individual."^ These advances have addressed such 
goals as enhancing the Nation's public health, 
military security, prestige, educational achievement, 
work force, technological development, environ- 
mental quality, and economic competitiveness. 

To say only that research contributes to national 
goals, however, simplifies and understates a com- 
plex system. Research is no longer a remote, 
scientist- or engineer-defined activity resulting in 
new knowledge for society. Perhaps it never was. 
"Deeply held political values of democratic ac- 
countability and public scrutiny have naturally and 
inevitably impinged on science policy. Demands for 
observable benefits from public investment in sci- 
ence increase, "2 Such demands have led to claims 
that scientific research has a significant and direct 
impact on the economy, and that an investment in 
knowledge is a downpayment on the products and 
processes that fuel U,S. economic growth and 
productivity.^ Economists admit, however, that the 
difficulties in measuring the benefits of research 
**...are hard lo exaggerate."^ The Nation now 
expects that in addition to knowledge, science and 
engineering will contribute to U.S. prestige and 
competitiveness abroad, create new centers of re- 
search excellence on a broad geographic basis, 
continue to provide unparalleled opportunities for 
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Photo crmJit: R0S0Mrch TriMgh InstHuf 

Scientists at the Resear^t> T.^jngle Institute. NC, 
synthesize chemicals for U'*v.'<r research. Scientific 
research takes place in m^any settings in the United States. 

education and triiining, and nurture a more diverse 
research work force. 

Thus, the Federal Government funds research to 
achieve more than specific national goals. By doing 
so, it invests in knowledge — and the people who 
produce it — not only for its intrinsic worth (which 
can be considerable), but also for the value knowl- 
edge acquires as it is applied. 

Scientific research is typically split into two 
categories, ••basic" and ••applied.'' Basic research 
pursues fundamental concepts and knowledge (theo- 
ries, methods, and fmdings), while applied research 
focuses on the problems in utilizing these concepts 
and fomis of knowledge. OTA does not generally 



•Harvey Brooki, *'Knowlc<tgc and Action: The Dilemma of Science Policy in the 70s." Daedalus, vol. 102, spring 1973. p. 125. Unless otherwise 
itaicd, • •icicijcc ' ' in Uiis report ii *t iudes (be social and behavioral science* as well as the namral sc ienccs and engineering. "Research' ' refers to a creaii vc 
activity oi\^o\r,% in all of ehcse fidds. 

-Kcnn^:tli Prewitt. '"Fbc public and Science Policy." Science, Technology, ^ Hunuin Values, vol. 7. spring 1982. p. 13. 

^Sec Edwin Mansfield. ' The Socio) Rate of Return Prom Academic Research/' Research Policy, forthcoming 1991: an^i James D Adams 
^•Fundamemal Slocks of KiiOwlcdge ana Productivity Growth." Journal of Political Economy, vol. 98. No. 4. 1990. pp. 673-702. 

Quoted in Eugene Garfield. "Assessing the Benefits of Science in Temw of Dollars and Sense." The Scientist, vol. 4. No. 22. Nov. 1 2. 1990. p 14 
Hic source U Naihan Rosenberg and David C Mowcry. Technology and the Pursuit ofEconottuc Growth (New York, NY: Cambridge University Pr-ss, 
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distinguish between these categories in this report, 
because policymiUcers, especially Congress, make 
very few decisions in which the two are separate. In 
particular, research agency program managers rarely 
allocate monies on the basis of a project's basic or 
applied classification, and divisions of research 
funding into these categories are often unreliable*^ 

This Report and Its Origins 

In December 1989, the House Committee on 
Science, Space, and Technology requested that OTA 
assist it in understanding the state of the federally 
funded research system — its goals, research choices, 
policies, and outcomes — and the challenges that it 
will face in tlie 1990s. By requesting a study of the 
state of the Nation's research system and of alterna- 
tive approaches the Federal Government could take 
in funding research, the Committee sought informa- 
tion on the nature and distribution of research 
funding and decisionmaking. Direct congressional 
involvement in research decisionmaking is growing, 
and annual agency appropriations seem more closely 
tied to specific goals — and tough choices among 
them — than ever before.^ As one member put it: 

... the payoffs for the Nation are so great that 
increased investments in science and technology are 
only pnident. However, even if we could double the 



science budget tomorrow, we would not escape the 
need to establish priorities. . . . ^ 

The Federal Government has sustained an illustri* 
ous history of support for research. Underlying this 
relationship between government and the scientific 
community was a social contract or ''trusteeship,'' 
developed after the scientific breakthroughs spurred 
by World War II, that delegated much judgment on 
Federal research choices to scientific experts.^ 
Perhaps the epitome of the trusteeship was the 
research grant, which created a new relationship 
between the Federal Government and the research 
perfomier, especially the principal investigator in 
universities.' This social contract implied that in 
return for the privilege of receiving Federal support, 
the researcher was obligated to produce and share 
knowledge freely to benefit — in mostly unspecified 
and long-term ways — the public good.^^ 

Since the 1960s, Federal fund*:ig for research 
(both basic ari applied) has incre'4sed from roughly 
$8 billion in 1960 (1990 dollars) to over $21 billion 
in 1990 (see figure 1-1). Funding increased quickly 
in the early 1960s during the ••golden years" for 
research, after the launch of the Sputnik satellite, the 
escalation of the Cold War, and the Presidential 
commitment to land men on the Moon. Once these 
challenges had been met, research fimding decreased 



'A qiianer*ceniury ago it wu noted that: ''The precise petitioning of all basic resteajth into components is, of course, largely arbitrary. Basic reseaah 
can be classifiH in terms of its mtivation—^ r'llturc, as an adjunct to education, as a means to accomplish nonscieutific goals of the society; of its 
sources of support— whether mission-oriented agency or scicrKC-oricnied agency; of iu performers^-yfi/hcWiet university, government laboratory, or 
privfte inv''u;*Ty; or of its character--whc\hcr 'little science' or 'big science.' Any one of these classificatiofis. if applied consistently, cover aJl basic 

science, bui none is wholly satisfactory * ' See National Academy of Sciences, Committee on Science and Pubhc Policy. Basic Research and National 

Goals, A Report to the Committee on Science and Astronautics, U.S. House of Representttives (Washin<>ton, DC: March 1965), p. 9. italics added. This 
wM independently confirmed by extensive OTA interviews with research agency personnel, spring-summer 1990. Ibday, research is a'w sometimes 
labeled ' 'strategic, ' ' ' ' targeted, " or ' *precompetiti ve, ' ' for euunpio. For an update and discussion, see Harvoy Avcrch. * 'The Pohiical Ec( iOmy of R&D 
Tixxot^Ximie^** Research Policy, forthcoming 1991. 

*Sec National Academy of Sciences, Federal Science and Technology Budget Priorities: New Perspectives and Procedures (Washington. DC: 
National Academy Press, 1989); and U.S. Congress, House Committee on Science. Space, and Technology, Subcommittee on Science, Research, and 
Teclmology, The Hearings on Adequacy, Direction and Priorities for the American Science and Technology Effort, 101st Cong.. Feb. 28-Mar. 1, 1989 
(Washington, FXT; U.S. Oovcriuncnt Printing Office, 1989). 

^Doug W&lgren, Cliairman of tlic House Subcomimttee on ScieiK^c. Research, aiul TechiK}logy. in House Cuinmiiiee on Science, Space, and 
Technology, op. cit., footnote 6. pp. 1-2. 

'Research as a planned activity of the Federal Government can be traced to two landnrurk volujncs: Vanr^var Bush's 1945 "A Report to lite President 
on a Program for Postwar Scientific Research' ' (subsequently known as Science: The Endless Frontier), which iiutigafcd the creation of an agency — the 
National Science Foundation— whose dual mission wu the promotion of research and science education, and Science and Public Policy, or the 1 947 
Steelman Report, which championed a crosscutting policy role for managing federally funded research. For interpretatioai. see J. Merton England. A 
Patron for Pure Science: The National Science Foundation s Formative Years, 1945-57 (Washington, DC: National Science Foundation, 1982); and 
Deborah Shapley and Rustum Roy. Ust at the Frontier (Philadelphia, PA: LSI Pre.QS. 1985). 

^Scc US. Congress. House Committee on Science arid Tcchrioiogy. T^sk Force on Science Policy, A History of Science Policy in the United States, 
1940^1985. 99th Cong., September 1986 (Washington, DC: U.S. Government Printing Office. September 1986). pp 19-20. Also see Rodney W. Niclwls. 
••Mjssion-Oricnied RAD." Science, vol. 172. Apr 2. 1971. pp. 29-37. 

'^For examinations, sec Bruce L.R. Smith, American Science Policy Since World Wjr // (Washington, DC: Ilje Brookings IiLstitution, 1990), 
cspeciilJy clis. 1 aiki 3; Gene M. Lyons. The Uneasy Partnership Social Science and the Federal Government in the l^enneth Century (New York, 
NY: Russell Sage Fouiklaiion, 1969); and U.S. Congrcs:?, Office of Technology Assessment, The Regulatory fEnvironmem for Science, OTA-TM-SET-34 
(Washington, DC. U.S. Govermnent Prmting Office, I-cbruary 1986), pp. 15- 16. 
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Figure 1-1— Federally Funded Research (Basic and 
Applied): Fiscal Years 1960-90 
(In billion* of 1982 dollars) 
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NOTE; Rflurss w«rs convertod into cofv.tsnl 1 982 dollars using the GNP 
Implicit Pric« Dsflator. For 1 990 (currsnt dollars), basic rasaarch - 
$11. 3 blliion. appjiad rasaarch « $10.3 bitllof), and total rasaarch « 
$217 t)jlllon. 1990 figuraa ara aatimatas. 
SOURCE: National Sdanca Foundation, F^d^rMf Funds for Research and 
D^vetopment, MaJfed Historical Tables: Fiscal Years 1955- 
f99(J(Waahlngton. DC: 1990), taUa A; and National Sdanca 
Foundation, Selecfe^J Data on Federal Funds for Research and 
Development: Fiscal Years 1989, 1990 and 1991 (Waihington. 
DC: Dacambar 1 990). tat3<a 1 . 

slightly and leveled off from the late 1960s until the 
mid-1970s. From 1975 onward, however, Fe<!eral 
reseiirch funding again increased, due in k'-ge part to 
the expansion in health and life sciences research.'* 

Along with this increase in research fundings the 
number of academic researchers grew steadily. 



Figure 1-2— Doctoral Scientists and Engineers in 
Academic R&D: 1977-87 
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NOTE: Thara was a changa In tha wording dl ina National Sdanca 
Tou'^viatlon survsy quaslionnalra of aoadamlo Ph.DA In 1987: 
raspondants wara aakad to Wartlfy whathar "raaaarch" was thair 
p/Z/Twry or sacorxtoz-ywofk activity. TWs Changs may hava raiultad 
in an artlfldaily larga Incraaaa from 1985 to 1987 In "academic 
rasaarchars." Prior to 1987. Ph.D.s In acadamla wara only askad to 
Idantify Ihalr primary work activity. 

SOURCE: National Sdanca Board. Sdenoe % Engineering hdic^tora— 
1989, NSB 69-1 (Waahington, DC: U.S. Govarnmant Printing 
Offlca. 1 989). appandix tabia 5-1 7 and p. 1 1 5. 



perhaps by as much as 60 percent from 1977 to 1987 
(see figure 1-2). More generally, from 1980 to 
1988, sci-intists and engineers in the work force g^e^/ 
by an average of 7.8 percent per year, four times the 
annual rate for total employment.*^ Not surprisingly, 
the competition for research funds among these 
scientists and engineers also intensified. By the late 



t»Scc National Science Foundation. Federal Funds fo- Hesearch and Dfveiopnunt-^Detailed Historical Tables- Fiscal Years 1955-1990 
(Wa/ihington. 1X2. 1 990) for discussions. «!C WilJiam D. Carey. ••R&D in the Federal Budget: I91(h\990r Scierue and Technology and (he Changing 
Worl^i Order. Coll«iuiurn Proceedings. Apr. 12- 1 3, 1990. S.D Sauer (cd ) (Washington, DC: American Association for the AdvaiKcnksnt of Science. 
I^Oci^24^ 19^^^ Ocncvicve J. Knc/x), • 'Defense Basic Research f^rioriiies: Funding and Policy Issues," CRS Report for Congress (Washington, 

»2Notc. however, that ifjere was a change in ttve wording of ihc National Science Foundation survey questionnaire, wliich may have n;sultc<l in an 
a/imclally large increase from 1985 to 1987 in tliose thai Identify •'research" as their primary or secondary work activity. Prior to 1987 Pti D s in 
academia were otily asked 10 Identify their pN/?wry work Hctivity. This protwbly undeitsstimatcd Die number of academic Ph.D researchers in Uic United 
SutC5^ See National Science Board. Science A Engineering induaior^m9. N5:B 89-1 (Washington, DC: Congressional Research .Service. 1989), 
app. table 5*17 * ' 

"Ibid , p 67 
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1980s, researchers supported by the Federal Govern- 
ment had become increasingly restive over fundmg. 
Tbday, many say that their lives as researchers have 
become more stressful and laden with the paperwork 
of proposal applications and accountability for 
awarded funds, inhibiting the creativity and joy of 
the research process.** They cite the declining 
fraction of meritorious proposals that are funded, 
new investigators lacking the support to set up 
independent research groups, and the fear that U.S. 
students will turn their careers away from academic 
science and engineering.^^ 

Tod 7, because the scientific community has the 
capability to undertake far more research than the 
Federal Government supports, policymakers and 
sponsors of reseaich must continuously choose 
between competing ••goods." (The tensions under- 
lying these choices are summarized in table 1-1.) 
Controversies over the support of younger scientists 
and established researchers, •'have" and ''have- 
not" institutions, and tradeoffs among fields are all 
manifestations of the consequences of choices 
perceived by various segments of the ''scientific 
community."*^ Scientific community, as used here, 
refers to a political entity. Like other sectors, science 
contributes to national goals and competes for 
Federal resources. At a more practical level, the 
scientific coitimunity invoked by Congress and the 
Presidential Science Advisor refers to a heterogene- 
ity of professional associations, lobby activities, and 
actual research performers. (These disciplinary or 
subject-specific divisions and interest groups more 
accuratel; correspond to what OTA calls * 'research 
communities.") 



Additional funding for science and engineering 
research would certainly be a good investment of 
Federal resources. There is much that could bo done, 
and many willing and a^^e people and institutions to 
do it. The focus of this ♦rt, however, is not on the 
level of investment, bt m the "Federal research 
system." As the sum of the research programs and 
efforts that involve the support of the Federal 
Government, ttie "system" is best characterized as 
the conglomeration of many separate systems, each 
with constituencies inside and outside of science. 
How these participants compete, cooperate, and 
interact in processes of Federal decisionmaking 
determines which research is funded by the agencies 
and performed by scientists and engineers. 

If large increases in the budget were to material- 
ize, it would not necessarily relieve system stresses 
for long. Additional research funding would cer- 
tainly allow the pursuit of nnore scientific opportuni- 
ties and yield fruitful gains, but it would also enlarge 
the system and increase the number of deserving 
competitors for Federal support. Thus, such stresses 
must be addressed with other policies. In the short 
term, the government faces a rising budget deficit. 
Congress has set targets to reduce the deficit and 
eventually to balance the budget.^^ In this fiscal 
climate, the research system may not be able to 
maintain the growth in Federal funding of research 
that it experienced in the 1980s. Regardless of 
funding levels, however, issues of management, 
funding, and personnel remain. 

Given the extraordinary strength of the U.S. 
research system and the character of scientific 
I esearchi there will always be more opportunities 



^^Saeme The End of the Frontier? A report from Leon M. Udcrraan, Prcsideni-Elcci lo ihc Board of Directors of the Amcriaui Association for ibe 
Advanccmcnl of Science (Washington, DC: American Aisociaiion for the Advancemeni of Science, Jan. 31, 1991 ). 

'^Thcse were the prominent issues, for example, at the National Academy of Sciences/Institute of Medicine, "Fonmj on Supporting Biomedical 
Rcsrarch: Near-Term Problems and Options for Actioik" Washington, DC. June 27, 1990. Recent discussion has paradoxically focused on the broad 
field of the life sciences where Federal funding increases have been most generous for the last 1 5 years. In iu initial effort to document change and stress 
in the Federal research system created by an abundance of research applications^ OTA tound that an increasing proportion could not be funded by various 
research agencies due to budget limiUtions» 'alher tha^ to deficiencies of <^«iaJiiy. U S. Congress, Office of Technology Assessment, **Proposai Pressure 
ill the 1980s: An indicator of .Stress on the IWeral Research System,*' %i Tpapcr of the Science. Education, and Transporution Program, April 1990. 

'<^Sce Insiinite of Medicine. Funding Health Sciences Research A Strategy to Restore Balance (WuhitxiiGo, DC: National Academy Prcas, November 
i 990). For insight into the contentiousness that greeted the losdtute of Medicine report, sec Peie» G. Gotsciin, * » A Clash of Scientinc Titans: Key Groups 
Battle Over Funds for Medical Projects." The Washington Post. Dec. 18/25, 1990. Health section, p. 6. 

»^As one political scientist writes: *\ . . because the Federal RAD system is comprised of so nuny independent acton, each of whom lend lo view 
science and engineering from a relatively narrow perspective, the FedenU RAD system proceeds virtually without planning and coordination. If it 
nwvcs ... it docs so . oozing slowly and Incrementally in several diiections at once, with consUnQy changing boundaries and shape." Joseph G. 
Moronc. "Federal RAD Structure: The Need for Change," The Bridge, vol. 19» fail 1989, p. 6. 

'•T1« debt held by the Federal Government recently topped $3.1 trillion, and payments on ihc debt exceeded $255 billion in fiscal year 1990. ThcMC 
figures are ex|)ectcd to rise significantly in 199 1 and 1992. with the costs of the war in the Persian Gulf arid the bailouts of the Nation's financial system. 
For an c;^planation of the Budget Enforcement Act of 1990. sec Lawrence J . liaas. "New Rules of the Game." National Journal, vol. 22, No. 46, Nov. 
IV. 1990. pp. 2793-2797. 
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Table 1-1— Tensions In the Federal Research System 



Centralization of Fedef al research planning 
Concentrated excellence 

"Marker* forces to determine the shape of 

the systenfi 
Continuity In funding of senior investigators 
Peer review-based allocation 



i — ► 



Set-aside programs 



Conservatism In funding allocation 
Perception of a "total research budget" 
Dollars for facilities or training 
Large-scale, multlyear, capital-intensive, 

high-costi per-lnvestigator initiatives 
Training wore researchers and creating 

more competition for funds 
Emulating mentors' career paths 
Relying on historic methods to build the 

research work force 



Pluralistic, decentralized agencies 
Regional and institutk>nal devetopment (to 

enlarge capacity) 
Political intervention (targeted by goal, 

agency, progranii Institution) 
Provisions for young investigators 
Other funding decision mechanisms (agency 
manager disaetlon, congressional ear- 
marking) 

Malnstreamingcriterlainadditionto scientific 
merit (e.g., raoe/ethnictty, gender, princi- 
pal investigator age, geographk) region) 

Risk-taking 

Reality of disaggregated funding dedstons 

Dollars for research projects 

indlvkiuai investigator and small-team, 1-5 
year projects 

Training fewer researchers and easing com- 
petition for funds 

Encouraging a diversity of career paths 

Broadening the participation of tradltk)na!ly 
underrepresented groups 



SOURCE: Oftlc« of Tschnotogy AssMsment, 1991 . 

than can be funded, more researchers competing 
than can be sustained, and more institutions 
seeking to expand than the prime sponsor — the 
Federal Government — can fund. The objective, 
then, is to ensure that the best research continues 
to be funded, that a full portfolio of research is 
maintained, and that there is a sufficient research 
work force of the highest caliber to do the job. 
This report is designed to support Congress in 
achieving these goals. 

Trends in Federal Research Funding 

The research system has shown itself to be 
remarkably robust over at least the last 30 years, and 
it has done well with the resources it has received. To 
develop multiple perspectives on the system. Fed- 
eral funding can be examined by agency, broad field, 
and category of recipient. 

Figure 1 -3 displays Federal funding trends for the 
six largest research agencies. Since 1973, the 
Department of Health and Human Services (HHS, 
largely through the National Institutes of Health — 
NIH) has supported more research than any other 
Federal research agency. In fiscal year 1989, HHS 



supplied nearly twice the research funds of die next 
largest research agency, the £)epartment of Defense 
(DOD). HHS and DOD were followed by die 
National Aeronautics and Space Administration 
(NASA), die Department of Energy (DOE), the 
National Science Foundation (NSF), and die Depart- 
ment of Agriculture (USDA).^^ 

Reflecting the division of research funds by 
agency and broad field, a 20-year time series is 
shown in figure 1-4. Life sciences continues its 
steady growdi relative to odier broad fields. In fiscal 
year 1990, life sciences dominated Federal funding 
at $8.9 billion (in 1990 dollars). Engineering was 
funded at slightly less dian one-half the level of 
support given to die life sciences ($4.4 billion), as 
were the physical sciences (roughly $4 billion). 
Environmental and mathematics/computer sciences 
were funded at $2.1 and $0.7 billion respectively, 
and die social sciences togeUier gathered $0.6 
billion. 

Turning to research performance, universities and 
colleges in die aggregate are the largest recipients of 
federally funded research (basic and applied, see 



''Congress is mosi inlcrcstcd in comparing research expenditures to other elements of the Fcdcrtl budget. Thus, a dcflatof that reprcsr m r xpenditures 
on pi xiucts and services thai ajc often boughi throughout the United States— a '*consuni dollar" in the vnosl general sens^- is oflen tlic inost useful 
for congressional policy analysis. Given ilic problems with rcsearch-sptccific deflators and the advantage of a gencral-GNP deflator to compare 
expcQditurc^ across the ccoiwmy. all constant dollar graphs aiKi tables in this report were calculated with the GNP Imphcil Price Deflator for 1 982 dollars 
(sec ch. 2). 

^oie thai the order of these agencies would be changed if research and developmcnl or basic research were used lo rank ihcm. TTm remaining 
agencies, not included in the lop six. together fund less tlian 5 percent of the research supported by the Fe<leral Govemment. 
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Figure 1 -a— Federally Funded Research In the Major 
Research Agencies; Fiscal Years 1960<90 
(In billions of 1982 dollars) 
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KEY: HHS-U.S. Dop«r1m«nt o1 Health and Human Swvioes; DOO-U S. 
Department of Defense; NASA-National Aeronautics and Space 
Administration; DOE-U.S. Department of Energy; NSF-Natlcnai 
Science Foundation: USDA-U S. Department of Agriculture. 

NOTE: Reaearch includes both basic and applied. Figures were converted 
to constant 1982 dollars using the GNPbnpiicit Price Deflator. t990 
figures are estimates. 
SOURCE: National Science Foundation, Federa/ Furxis forR^sssrch and 
D0v^opm0f)t, D0talM Historicat Tabf^: Fiscal Yamrs 1955- 
fddO (Washington, DC: 1990), table A; and National Sdence 
Foundatksn. S^fBct^ Data on Fadaral Funds for Rasaarch and 
Davafopmant: Fiscal Yaars 1989, 1990 and WMWashington, 
DC: December 1 990). tables 4 and 5. 

figure l-.*5). From 1969 to 1990, Federal funding for 
research at universities and colleges grew from over 
$4 billion to nearly $8 billion (in constant 1990 
dollars). In 1990» perfonnance of research by 
industry (at over $3 billion) and the Federal labora- 
tories (at over $6 billion) are funded at lower levels. 
For basic research alone (not shown), universities 
and colleges are even more clearly the dominant 
research perfonner at over $5 billion when com- 
pared with Federal laboratories, the next largest 
basic reseiU*ch performer, at slightly over $2 billion. 



Figure 1-4— Federally Funded Research by Broad 
Field: Fiscal Years 1960-00 (In billions of 1982 dollars) 
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NOTE; Rftsaarch Indud^s both basic and applM. Fields not indudad in 
this figure cx>i)aclivaly accountad for $1 .1 billion (4.0 parcani) of all 
fedorally fundad raaaarch in 1990. Figuran wara oonvarlad to 
constant 1 962 doliart using tha GNP Impdcit Prlca Oaflator. 1 990 
figures araasttmatas. 
SOURCE: Nationai Sdanca Foundation. Fadaral Funds for Raaaaxh and 
Davaiopmant, Datalhd Histaricai Tabiaa: Fiscal Yaar$ 1955- 
r9dO(Washington» DC: 1990). taUa 25; ar>d National Sdanca 
Foundation, S^lactad Data on Fadarai Funds for Rasamrvh and 
Davaiopmant: Fiscal Yaars 1989. 1990 and 1991 (Washington, 
DC . Decambar 1990). tab<a 1, 



ITic distribution of Federal research and develop- 
ment (R&D) funds has long been a contentious 
issue— both in Congress and in the scientific com- 
munity. As shown in figure 1-6, if these funds are 
aggregated by the State of the recipient institution or 
laboratory, tlien five States received 53 percent of 
the R&D funds in fiscal year 1990 (California. 
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Figure 1-5— Federally Funded Research by Performer: 
Fiscal Years 1969-90 (in billions of 1982 dollars) 
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KEY: FFRDCs indude ail Fsdorally Funded Research and Development 
Centers that are not administered by the Federal Government. Other 
includes Federal fufKls distributed to State and local Qovernmenis 
and foreign performers. 

NOTE: Research irx:ludes both basic and applied. Figures were converted 
to corwiani 1 962 dollare using the GNP Implicit Price Deflator. 1 990 
figures are estimates. 

SOURCE; National SdefKe Foundation, F0d^alFund$ for R$tMch and 
D0V0fopm9nf, MalM Histoncal Tables: Fhcml VWars 1955- 
t9P0 (Washington. DC: 1990). tabfe 17; and National Science 
Foundation, Se/ecfedDafa on Fmieral Funds forR0SBSirch and 
Dev^opment.'FJsc^ YBars 1999. 1990 and 1991 (Washington. 
DC: December 1990). table 1. 



Figure 1-6— Federal R&D Obligations by State (1985) 
and at Universities and Colleges (1989) 

Cumulative distribution of Federal R&D 
obligations by State: 1966 
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Cumulative distribution of Federal R&D 
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colleges: 1989 
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SOURCE: National Science Foundation. GBogrmphicPattamn: MDintha 
United StBfs. Final Report. NSF 90-316 (Washington. DC: 
1990). table B-5; and National $denc« Foundation. Sehcted 
Data on Acadomic SdancWEngin^nQ RSD Expenditures, 
Fiscal Yaar 1939, NSF 90-321 (Washington. DC: October 
1990). tabfe B-3S and CASPAR database. 



Maryland, Massachusetts, New York, and Vir-. 
gmia).2» (Research institutions are also not ran- 
domly dispersed across America; rather, they are 
concentrated on the two coasts and the upper 



midwest.) At the other end of the distribution, 15 
States together received less than 2 percent of tlie 
funds. At the institutional level, 10 universities 
receive 25 percent of the Federal research funding. 



Ar.niJSn!Sr r '^"^^ itcvelopmcul. becausc figufw for research aJonc arc not available. Based on 1984 data, the General 

j^ounimg Office found yanous patterns of corvcenlraiion among perfomiers: rc^earchen ui 10 Stales submitted over o^(^half of the proposaia to the 
^^ aiul the National Institute., of Health, supplied almost 60 percent of ihe proposal reviewers, and won ov^^^J^^^^^^ 

DC Febniary 1987) p. 43. Tt^tsc figures, however, ignore other relevant factor, in judging the -fair- distribution of Federal research fund, such a5 
Ken AlsJ^^^^^^ """S';^.' engineers living .n .t. No matter how fair the compeiUivc process, tl. outcomtnuyltil 

De seen as ui^air^ Ahojce William C Boe,snuin and Christine Matthews Rose. -Equity. Excellence, arMl the Distribution of Federal Research aiid 
Development Funds." CRS Report for Congrn, (Washmgton, DC: CongressiomU Research Service, Apr. 25. 1989) 
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and only 30 universities account for 50 percent. 
Funding is concentrated in 100 research universities 
in 38 States. This reflects their importance to the 
Nation's research enterprise. 

These data on the distribution of resources bear a 
critical message: research capabihties—institutions 
and people- -take time to grow. It is not simply a 
matter of ''they who have, get.'' The reputation, 
talent, and infrastructure of research universities 
attract researchers and graduate students.^^ Some 
universities become assets not only in the production 
of filftdamental knowledge, but also in bridging 
science and technology to other goals such as State 
and regional economic development. 

Federally Funded Research in the 1990c 

Snapshots of federally funded research, compar- 
ing fiscal years 1980 and 1991, are provided in table 
1-2. Research is a small portion of the total Federal 
budget. Although the distribution of research funds 
by agency sponsor, category of performer, and 
stratum of academic institution has hardly changed 
during this period, the activity has never been in 
greater demand. 

However, questions such as ''Ddcs the Nation 
need more science? and *'How much research 
should the Federal Government support?" have no 
ready answers. Measures of distress and conflicts 
over resource allocation within the scientific • im- 
munity do not address whether the Nation needs 
more science. Other problems in the Federal rc 
search system do not derive from, but are exacer- 
bated by. such stress. They include sparse participa- 
tion by women and ethnic minorities in science, 
indications that other nations are better able to 
capitalize on the results of U.S. research than 
American industry, and management problems that 
have plagued many Federal research agencies. Only 
some of these problems can be addressed solely by 
the Federal Government, and long-term solutions 
may not be found in adjusting Federal funding 
levels. Rather, they reflect problems in the organiza- 



tion and management of research and competing 
values within the scientific community 

•'How much is enough' ^ depends on the goals of 
the research system (see box 1-A). The system by 
definition takes on new goals, each of which can be 
evaluated. But in the aggregate how these goals are 
assimilated — by add-on or substiturion — is not eas- 
ily predicted. The challenge is not to determine what 
fraction of the Federal budget would constitute 
appropriate funding for scientific research. Rather. 
OTA finds that under almost any plausible 
scenario for the level of research funding in the 
1990s, there are issues of planning, management, 
and progress toward national goals to address. 

Because the reach of science is now great, 
decisions about the funding of research are intei- 
twined with many Federal activities. Congress and 
the executive branch, which make these decisions in 
our form of government, will continue to wrestle 
with scientific and other national priorities, espe- 
cially those that help prepare for tomonow's sci- 
ence — renewing human resources throughout tlie 
educational pipeline and building regional and 
institutional capacity. History cautions against the 
expecution that the scientific community will set 
priorities across fields and research areas. Congress 
must instead weigh the arguments made within each 
area against desired national outcomes. 

In the 1990s, the Federal research system will face 
many challenges. OTA has organized them here 
under four interrelated issues: 1 ) setting priorities for 
the support of research; 2) understanding research 
expenditures; 3) adapting education and human 
resources to meet the changing needs of the research 
work force; and 4) refining data collection, analysis, 
and interpretation to improve Federal decisionmak- 
ing. (For a summary of issues and possible congres- 
sional responses, see table 1-3.) Tb craft public 
policies for guiding the system, each issue is 
outlined in the following discussion. 



"iasiiiuiioai. like ihe faculty rcscarchcn employed by them, iccumuliie "idvanuge/' Among the many factors that inHucncc Fcdcnl research 
funding, institutiotui reputation is part of a cycle of crcdibUlty that gives inveitigators an edge in compctiUon for scarce resources— the very resources 
that strengthen the ittMitutlon as a productive research pcrfoiroer, which builds more credibility, and so on. Sec Robert K. Merton, "The Matthew Effect 
tn Science. 11: Cumulative AdvanUgc and the Symbolism of Intellcctiial Property/' Isis, vol. 79. No. 299. 1988. pp. 606-623. 

^^Scc Joshua Lcderbcrg. ' * Docs Scientific Progicss Come Prom Projects or People? ' ' Current Contents, vol. 29, Nov. 27, 1989. pp. 4- 12. In this rcpon. 
OTA concentrates on Federal, especially agency, perspectives on research. Performer (researcher and institutional) responses to changes In FedcraJ 
policies and programs were included to broaden undcnunding of the Federal role vis-a«vis academic research, since universities are the primary' site 
for research perfomiance and most data arc collected on universities. HowevCT. national laboratories and industry play targeted roles and figure 
protnineutly in research funding docisioas. 
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Table 1-2— Federally Funded Research in the 1980s and 1990s (in perc9i^t) 



Rscal year 1980 rlsca' year 1991 (est.) 



R&D as percent of tola! Fejderal budget 5.0 4 7 

Total research as percent of Federal R&D 38.9 36.3 

Basic research as percent of Fedora! R&D 15.7 19^1 

Basic research as percent of total Federal budget 0.8 0.9 



Agency Fiscal y ear 1980 FIsca! year 1991 (est.) 



Percent of Iota! (basic) research funds distributed, by agency HHS/NIH 29/24 (38/35) 34/29 (40/37) 

DOD 20(12) ' 15 (8) 

NASA 14(12) 16(15) 

DOE 11 (11) 12 (14) 

NSF 8(t7) 9(15) 

USDA 6 (6) 5 (5) 

Other 7(4) 10 (4j 

. Performer '^iscal year IT/SO Fiscal year 1991 (est,) 



Percent of lota! (basic) research funds, by performer Universities 32 (50) 36 (47) 

Federa! 32 (25) 30 (23) 

Industry 18 (7) 15 (9) 

Nonprofits 6 (6) 8 (9) 

FFRDCs- 1 M11) 11 (12) 

Ranking Fiscal year 1 980 Fiscal year 1 988 

Percent distnbution of Federal R&D funds at academic institutions Top 10 25 25 

Top 20 40 39 
Top 50 68 65 
Top 100 84 85 



KLY. DOD-U S Dnparlmont of Dofenso. DOE-U S Doparlmont of Enorgy. Ff-RDC-FedGrEdly Funded ReGoarcti an».1 Developmen! C«n!or: USOA-U S 
DGpaftmGnlofAgricuiture;NSr-NatJonal Science FoufKlal(on.HHS/N!H-U.S Doparlmen! of Health and Human So/ viceii/National Institutes of Health. 
NASA-Natronal Aeronautrcs and Space Admintstralion 

'The category of FFRDCs rndudes alf Fed«rnlly Funded Research and Developmen! Centers thai are nof administered by the Federal Government. 

NOTE. R&Ddala are based on Federal obligations, calculations involving the total Federal budget are ba^edon outlays. Columns. nay not sum to 100 percent 
due to rounding 

SOURCES. Office Of Technology Assessment. 1991. based on National Science Fou/xialion data. U S General Aocounlmg Office data; Economic Report 
oftho Pffls/denf (Washington. DC. U S Government Printing Office. 1991). and Budget of m UniM Stales GovornrnQnt. Fiscal Year \9dQ 
(Washington. DC US Government Printing Office. 1991). 
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ISSUE 1 : Silting fVioritit's in the 
Su()(Kjrl of Research 

Summary 

Priorities aire set throughout the Federal 
Government at many levels. At the highest 
level, reseiu^ch priorities are compared to 
nonscience and noncngineering needs. At the 
next level, priorities {ire set across research 
fields, such as biomedicine and mathematics. 
Within fields, agency programs reflect re- 
search opportunities in subfields and relevance 
to national needs. Finally, research projects are 
compared, ranked, and awarded Federal funds. 
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Although priority setting occurs throughout 
the Federal Government, it falls short in three 
ways. First, criteria used in selecting various 
areas of research and megaprojects are not 
made explicit and vary widely from area to 
area. Tliis is particularly true, and particularly 
a problem, at the highest levels of priority 
setting, e.g., in Uie President's budget and tlie 
congressional decision process. Second, there 
is currently no mechanism for evaluating the 
total research portfolio of the Federal Govern- 
ment in terms of progress toward many na- 
tional objectives, although recent efforts by the 
Office of Science and Technology Policy have 
lead ir some cross-agency planning, budget- 
ing, ;ind evaluation. Third, the principal criteri?i 
for selection, scientific merit and mission 
relevance, arc in practice coarse filters. Con- 

2u 



L! • fvdvrally f undni Wcv^iirr /); Ihu i^ions for ,} Drciidc 



Box 1-A — How Much is Enough? 

'How nuicli is enough money for research?** is a question tliat can only be asked if it is clear vliai scientific 
and engineering rescarcli in the United States is attempting to accomplish; research for what? 

1. Is the primary goal of the F^ederal research system to fund the projects of aU deserving investigators of 
natural and social phenomena? 

ft so. tlien there will alway*^ be a call for more money, because research opjxmuniiios will always outstrip 
the capacity to pursue them. 

2, Is it to educate the research work force, or the larger science and engineering work force, needed to supply 
the U.S. economy with skilled labor? 

If so, then support levels can be gauged by the need for more technically skilled workers. Preparing studenf s 
throughout the educalional pif>elinc will assure an adequate supply and diversity of talent. 

3, Is it to promote economic activity and build research capacity throughout the United States economy by 
supplying new ideas for industry and other entrepreneurial interests? 

n so. then the support should be tiU'geted in line with our efforts to pursiie applied research, development, 
imk\ teclinology transfer. 

4. Is it all of the above and other goals besides? 

If so, then some combination of these needs must be considered in allocating Federal support. 

Indicators of stress and competition in the research system do not address the question of whether science needs 
tnore funding ti) do more sncnrv. F^nther, they sfH^ak to the organization and processes of science and to the 
competitive foundation on whicli the system is buih and that sustains its vigor. 

hxlucation, economic activity, and otJier national goals have long been confroiite(i by Congress and tlie 
executive branch. Although the relative importance of these needs varies over time with new developments and 
crises, their absolute imjxjiiancc has ni)i been set. ITius, allocating resources to these needs lias always Dcctx a 
tradeoff, within a limited budgt • against other national goals and the progranis that embody them. 

Because of its intrinsic nieri; and importance to the Nation, research has consistently been awarde<j funding 
increases. Hut tliese do not compare to what some claim would be an appropriate level of funding for research to 
pursue a full agenda of opfX)rtunities. Deciding if the Nation is pursuing enough research opportunities or if the 
Nation needs more science is thus a complicated question, which requires that other deci.'iions about the nat ire of 
the reseiu-ch system and its goals be settled first. Table lA-1 re{X)rts the costs of some p^itentiai science initiatives 
as estimated m the late lyXOs. 

Table 1A-1— Sample Requests r-rorn the RfeSf>arch Community for Increased Funding 



Fiold or ayency F^eport or intiative Additional funds foqueslod*' 

NSF Inliialivo to douWo the NSF budget $2,1 btllion 

NASA space science Towards a Now Era in Space; Realigning U.S. Policies to New Over $1 billion 

Realities*^ 

Nouroscienco 1990s Docado of thr) Brain Initiative^ Over $1 billion 

USDA research grants Investing in Resoarch^^ $0 5 billion 

Behavioral and sooal scinncws — The Behavioral and Social Sciences; Achiev«rnenls ana $0.2(i billion 

Opportunities** 

Mathematical sciences F onewing U.S. fvlathornalics* $0 12 billion 

All academic research S:i0nce: The End of the Fronliof?o Over $10 biihon 

KF:Y NS^ -National Scionco F ouncJalion. NASA-Nattonal Awronnutics and Space AdiT^mistfiitior). US{)A»U S Ot«pjwiMjoni nl AgfK:ul?ur« 
•*Adjo!>'.o<J to 1990 dollHfS u'jiM9 tho t9«2 GNf* Implicit Price Defiiilor 

^'Niition.il AcvJorny r>f SciHnc»i!v National Aaid*imy of EnQinoonng. Corrvnjlt*H> on Spac«> PoliOy "TowiUdS a N«w { ftl «n Spue « Roalignir i^^ tJ 

Pufjcms to New nonhlios. Sp«K© Policy, vol 6. August 1909. pp. ;?3/ ?b5. 
^ D^tiin Ooc^do Nouroactflnti'its Court Support ' 7hn ScienUst, vol 4. No ?t. Oct ?9. I9*i0. p 8 
f^Nal"Onal Rosonrch Council. Invtfsttmg in /Vosoa/'rh (Woiihington. DC NalionnI Actidtirny Pro*.fi. ^9fl9) 

"National Reooarch Cour^cil. 7ha B#i/mw/or»i/ arid Soijul Siaonc*is. AcJuQvfvnonts and Ofiftortun,iiA<; (Washington [)(. Nalutnal A(-<HhrMw PniHs 
t9tta) 

'N.-^.-orjai Rosoiirch Council Honuwing H S Kliifhom^tK^ A f^an for tho lOOOa (Wn-'hinglon. DC. National AauJomy fVi^ss 1V90) 
9*J, u*/K« Thu fncloftho f'lDHttof -^.j fopf.-ri iiotu [hon W> iv^ioinuin, F^ror.id»>nt fliK't to Xha B<iard Of Oir<K:torq of thit ArnorK:«in A-ssot ialmi. Uu tn, 
A(Jvanttiin<>r^l ot S<.ionr*t ( Wai^^mfjton. DC An^orKjun Assoufltion for the AdvancerTiofit of Sc,ion/,«, Jur^ li 1901) 
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Table 1-3~Summdry of Issues and Possible Congressional Responses 



Issue 

Sotting priorities for research 



Possible congressional responses 



Coping with chanQing 
expenditures for 
research 



Hearings on crosscutting priorities and congressional designation of 
a body of the Federal Government to evaluate priority sotting. 

Application of criteria to: a) promote education and human resources, 
b) build regional and Institutional capacity In merit-based research 
decisionmaking, and c) t)alance little science and megaprojocl 
initiatives. 

Oversight of agency research programs that focuses on strategies to 
fulfill the above criteria, and on responses to priority setting. 

EncouragerT»ent of greater cost-accountability by the research agen- 
cies and research performers (especially for indirect costs, 
megaprojects, and other multlyear initiatives). 

Allowance for the agerxjies to pursue direct cost containment 
measures for specific Items of research budgets and to evaluate 
the effectiveness of each measure. 



Adapting education and 
human resources to rT>eet 
future needs 



Programs that focus investment on the educational pipeline at the 

K-12 and undergraduate levels. 
Attention to diversity In the human resource base for research. 

especially to the contributions of undorpartlcipatlng groups. 
Incontivos for adapting agency programs and proposal requlrorDonts 
to a changing model of research (where teams are larger, more 
specialized, and share research equipment and facilities). 

Funding to; a) augment within-agency data collection and analysis on 
the Federal research system, and b) increase use of research 
program evaluation at the research agendes. 
Encouragement of data presentation and Interpretation for use in 
policymaking, e.g.. empioying indicators and other techniques 
that measure outc^rms and progress toward stated objectives. 

SOUMCt: Offtco of Tochnolofly Assrtssmenl. 1991 . ~ 



Refining data collection and 
analysis to improve re 
search docisionrnakirig 



cern.s for developing human resources and 
building regional and institutional capacity 
must also be considered; these criteria 
strejigthen future research capability. While 
not every project or agency will factor these 
criteria equally, the total Federal reseiu*ch 
portfolio must address these concerns. 

Priority-setting mechanisms that cut acro.ss 
research fields and agencies, and that nuike 
selection criteria more rranspaient, must be 
Ntrengl]ie»»ed in both Congress and the execu- 
tive branch. Congressional oversight must 
evaluate the total Federal research fX)rtfolio 
based on national objectives, research goals, 
and agency missions. !n the executive branch, 
Congress should insist, at a minimum, on 
iterative planning thai results in: a) setting 
priorities iUTiong research goals, and b) apply- 
ing (after scientific merit and program rele- 
vance) otJier criteria to research decisionmiik- 
lug thai retlcci planning for the future. In 



addition, since megaproject costs affect the 
ability of other disciplines to start new, large 
projects, megaprojects are candidates for 
crosscutting priority setting. 

Discussion 

Priority selling can help to allocate Federal 
resources both when they are plentiful, as they were 
in the 196()s, and when ihey arc scarce, as expected 
through the early 19Ws.^** Governance requires that 
choices be maile to increase Che benefits and 
decrease the risks to the Nation. Priority selling 
occurs throughout the Federal (lovernmeni at many 
levels. Al the highest level, research priorities are 
compared to nonscience and nonengineering needs. 
Al the next level, priorities are set across research 
fields, such as biumetliciiie and mathematics. Within 
fields, agency research programs reflect research 
opportunities in subfieUls and relevance to national 
needs. I'inally, research projects are compiued. 
ranked, and awarded Federal funds. 



■'U'onyr.'ss ri\<y.in/.'.l Wic o! \uu^ui\ tii the .N.tiiofutl Si \c\kc and Ii%hn{)U)^v jNili^ y. ( >rx.irH/.Ui(>M, anil Priorities Act «>( IVM 

i\\ib\u I av »M /k;). \Us I I. Mrv> l-nf ,ui olui i(I..ih»n of iIk* «lil«'inin.f, jnhcfi-ni in pni.fHv MMtin^{. rspi'u.\li> uuiipansons hclwccn "N(K ial tmni" .ind 
xviinniK iiK-fil.'" sec A M VVViiilu'f^:./i?i«//<<//''^^''M/^rvN,jr^,,Ml;iir.hriilKr. MA Mil Press. Also sco Stephen P SUhWdiniJit'sfunhtirui 
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**** * »' 



Photo cr0di9: D^partmont of Energy 



Underground nuclear test craters dot Yucca Rat at the Nevada Test Site (NTS). In addition to nudoar testing, researchers at NTS 
explore other sclontiflo phenonrtena, such as geologic and seismic problents. 



Toward More Explicit Priority Setting 

There are three problems with priority setting as 
it is currently practiced in the Federal Government. 
First, criteria used in selecting various areas of 
research and megaprojects are not made explicit, and 
vary widely from area to area. This is particularly 
true, and particularly a problem, at the highest levels 
of priority setting — e.g., in the President's budget 
ami the congressional decision process. The best 
developed priority-setting mechanisms are within 
the resetU^ch agencies and at the agency program 
level. 

Second, there is currently no mechanism for 
evaluating the total research portfolio of the Federal 
Government in tenns of progress toward many 
national objectives. Research priorities must be 
considered across the Federal research system, and 
in particular, across the Federal agencies. What the 
Federal Government values more or less in rcseaich 
can be inferred in part from the Federal budget, but 



there is no '^research budget." Federal support is 
distributed across many executive agencies and falls 
under the jurisdiction of a number of congressional 
committees and subcommittees (see table M). 
Therefore, once allocations have been made to 
agencies (by the Office of Management and 
Budget — 0MB) or to appropriations subcommittees 
(by full appropriations committees), decisions are 
made independently within narrow components of 
what is after-the-fact called the research budget. 
This hampers the implementation of CTosscutting 
comparisons by Congress. 

During the 1980s. 0MB was a surrogate for a 
crosscutting agent, with Congress adding its own 
priorities through budget negotiations.^^ Recent 
efforts by die Office of Science and Technology 
Policy (OSTP) have lead to cross-agency plarming, 
budgeting, and evaluation in certain research and 
(Kiucation areas. President Bush has invested more 
power in OSTP to participate witli 0MB in delibera- 
tions over research spending, especially in targeted 



^VoT an overview, sec Elizabeth Baldwin and Oirisiophcf T. HiII, ' *llkc Budgei Process aud Largc-Scalc Sciences Fimdi«g/* CHS Review, Fcbnury 
I9H8, pp. 13^16. 
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Tabl« 1-4— Congressloniil Authorization Commltteea and Appropriations 
Subcommittees With Significant Legislative Authority Over R&D 

Jurisdlottofu^ o/ authorization commlttoos; * Agancy 

House: ^ 

Aflrlculture USDA 

Armed Sarvices DOD, DOE 

Er)argy and Commaroe DOE. ADAMHA, NIH. CDC. DOT 

Intarlof and Insular Affairs DOI 

Sdance. Space, and -nschnolOfly NASA. NSF, DOE. EPA. NOAA, DOT. NIST. DOI 

Public WwKs and Transportation NOAA. DOT 

Merchant Marine and FIsher'as USDA. NOAA. DOT 

Veterans' Affairs VA 

Foreign Affairs A.I.D. 

Senate: 

Agrlcultufe, Nutrition, and Forestry USDA 

Armed Services qOD. DOE 

Commerce. Sdence. and Transportation NSF. NASA. DOT. NOAA. NIST 

Energy and Natural .Resources .... DOE. DOI 

Ubor and Human Pdsources NIH. ADAMHA. CDC. NSF 

Environment and Public Worlds EPA 

Veterans' Affairs VA 

Foreign Relations \ A.I.D. 

Jurisdictions of appropriations committees: * Agoticy ~ 

Labor. Health and Human Services, Education ~ "~ 

and Related Agendes NIH. ADAMHA. CDC 

HUD and Independent AgerKies NASA. NSF. EPA, VA 

Energy and Water Development DOE 

Interior and Related Agendes DOE. USDA. DOi 

Agriculture, Rural Development, and 

Related Agendes*" USDA 

Commerce. Justice. State, the Judldary. 

and Related Agendes NOAA. NIST 

Transportation and Related Agencies DOT 

Foreign Operations /^j.D, 

Defense ][] [ [ \ \ ' ' ' OOD 

KEY: ADAMHA-Alcdiol, Drug Abuse, and Mtntsl H«alth Admlnlalrslton; A.I.D.«Ag«ncy for Intsrnatlonftl C)«v«lopm«nti CDC-Csntsrs for Ditsas« Control' 
OOD-U.S. Depirtmant of Defsnie; DOE-U.S. D«p«rlmen1 of Energy; DOI«U.S. Depsrtnrtiiol of lh« Inlertor; OOT-U.S. Depsrtmtnt of TfariM>ortallo// 
ERA-U.S. Environmsntal Prolsclloo Agerw:y: HUD-U.S. Dspartmsnt of Mouslno and Urban DevsioprYiant; NASA-National Aaronautlcs and Space 
Adminlstralion: NlfUNatlonal Inatitutas of HMlth; NIST-Nationai Intlltuta of Standards and Tachnotegy; NOAA^atlorMil Oceanographic and 
Atmotpharic Adminlstrallon; NSF-National Sdanoe Foundallon; USDA-U.8. Deparlmant of Agrtcullura: VA-U.S. Department of VWtanns Affairs. 
•Tha Jurisdlcttona of tha authorizing committtet are not axduslva. For t hte table, repeated authorization of a number of RaO^elated proorame was reouired 
to e3taWlih Juriedlcllon. ^ ^ 

OThe oorreepondlng aubcommltteee of the Senate and House Committees on Appropriations have the same name wfth one exception: the Senate 
Age^SIT Agriculture. Rural Deveiopment. and Related Agencies and the House Subcommittee on Rural Development. Agriculture, and Related 

SOURCES: Office of Technology Assessment. 1 991 : and EIL-^abeth BakMn and Christopher T. Will, "The Budget Process and Urae-Scaie Sdence Fundlno " 
CRS R0vi%w. Febnjary 1968. p. 15. 



Presidential priority area^5 such as high-performance 
computing, global environmental change, and math- 
ematics and science education.^* Since the Adminis- 
tration is moving in the direction of more centralized 
and coordinated priority setting, it is all the more 
important for Congress to consider priority-setting 
mechanisms as well. 



Third, although scientific nerit and mission 
relevance must always be the chief criteria used to 
judge a research area or agency program's potential 
worth, they cannot always be tlie sole criteria. In 
particular, the application of criteria that augment 
scientific merit— which represent today's judg- 
ments of quality — would help meet tomorrow's 



clcarci! pubhc statement of executive branch prioritic* is conuined in ^'EnhaDcinj^ Research and Expanding the Human Frontier." Budweiof 
thf United Statfs Goverhment. Fiscal Year 1992 (Washington, DC: U.S. Oovernmcnl Printing Office. 1991). pp. 35^76. The ground nile« for fitting 
crowcutting prioritiei through the Offkrc of Science and Tcchiiology PoUcy. Federal Coordinating Council on Science. Pjigineering. and -ftclwology 
Coinmince mechanism %xt detailed in the Office of Management and Budget (0MB) •»tcrnw of reference" memoranda (provided to OTA project iiaff 
dming an interview witii Robert E. Grady. Aisociaie Director, Natural Resources. Energy, and Science, and other 0MB staff. Feb 7, 1991 
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Box 1-&---Crlteria for Research Decisionmaking in Agency Progranfis 

Within agency research programs, research pnqposals have tiaditionaUy been selected for support on the basis 
of expert peer or progmm maoager judgments of '^scientific merit'' and program relevance. Many Federal agencies 
are now finding that the introduction of other explicit criteria is important for reseatch decisionmaking,* 

For examptot the National Science Board (NSB) established the folkming criteria for the selection of research 
projects by the National Science Foundation (NSF): 1) research performer compet^Ct 2) intrinsic merit of the 
research, and 3) utility or relevance of the research. In addition, NSB included 4) the . . effect of the research on 
the infrastructure of science and engineering, This criterion relates to the potemial of the proposed research to 
contribute to better understanding or improvement of the quality, distribution, or effectiveness of the Nation's 
scientiflc and engineering research, educatkm, and manpower base/'^ 

Under this fourth criterion, NSF includes: 

. . . questions relating to iciemific, engineering, and education penonnel, including panic^ation of wonten, 
minorities, and disabled individuals; the distribution of resources with respect to institutions and geogn^csl ares; 
stimulation of high quality activities in in^rtant but underdeveloped iklds; support of research initiation for 
investigstors without previous Federal research support as a Princ^ Investigator or Co-PriiKipal Investigates, and 
interdisciplinary approaches to research or e<faication in ap{»Qpriate areas.' 

In ^ort, this criterion defmes the bases for using other criteria in addition to scientifiv^ \wtit in mainstream 
allocations of research funds, and within set-aside piograms. Set-aside programs, at NSF and elsewhere, underscore 
the continuing need for "sheltered competitions" for researchers who do not fare well in mainstream disciplinary 
prograins/ 

As acknowledged by NSB, although scientific merit and program relevance must always be the primary criteria 
used to judge a research program or project's potential worth, they cannot always be the only criteria. For most of 
today's research programs, there are many more scientifically meritorious projects than can be funded. Ptoposal 



^OTA iAterviewt, tpring-summef 1990. 

^Quoted in National Sclefice Foundation, Grants for Research and Education in Science and Engineering: An Application Guide, NSF 
90-77 (Waihingfon* DC: Aufust 1990), pp. 8-9. 

^Ibld., p. 9. 

TA finds thai, in some programs at the Nationai Science Pbundatioo (NSF). the founh criterioa is not strongly heeded relative to the 
oii^r three criteria in the merit review process (OTA interviews, ipring-summer. 1990), NSF faces the impossible task of being all thls^ to all 
people. The organic act entrusta it with the suppon of the Nation's basic research aiMl science education. In tte acadetnic Institutioni that form 
NSF*s core clientele (liese activities are not pursued in the sante way or with the same vigor. Every research i^ognun at NSF now impacts on 
human resources for i^ience and engineering. This should remain foremost in mind when weighing policies for research programs. 



objectives of n;se:u(:h invcslmeiH. Hroadiy staled, 
there ;ire two Mich criteria: sirengiheniug education 
and hiimai'i resources at all stag^v of study (e.g.. 
increasing the diversity and versatility of [nirtici- 
panis); and builchnii regional and institutional capac- 
ity (inchuhng economic development by matching 
f-etleral resCiirdi sufiport witli funds from Stale, 
corporate, and iu)npr(^tit sources). 

fuhjcation atul human resources criteria would 
weigh research inUialives on their "proiluctioir * nt 
new researc-hers or teclmically skilled students. 
(Contributions to human resources include increas- 
ing participation in the eilucational pipeline (through 
tiegree completion), the lesearcti work force, and the 
larger science and engineering work lorce. Kegiv)nal 
and institutional capacity criteria woulil weigh 



research initiatives on Uieir contribution to under- 
paiticipating regions and institutions. Regional and 
institutional capacity are important concerns in all 
Federal funding, and encouraging new institutional 
participants and development of research centers 
strengthens the future capacity and diversity of the 
reseiucli syste?n. Some agency programs already 
incorporate these criteria in project se'ection (see 
box Ml). 

Can (\)ngress look to tlie scientific ci)mmunity 
for guidance on setting priorities'.^ The short answer 
is **no.'* Congress wislies —perhaps now more than 
ever -that the scientific community could offer 
priorities at a macro level for Federal funding. 
Science Advisor Bromley and former Science Advi- 
sor Fress have stated criteria and categories of 



ERIC 



2.) 



BEST COPY f 



Tit 



chapter 1— Summary and Issues for Congress • 17 



review could thus be an iterative process. First, a pool of proposals could be identifica based on scientific merit and 
program relevance* and those with exceptional human resources and/or research infirastnicture potential so 
indicated. The program manager, with or without the advice of expert peers* can then pick a balanced subset fimn 
the pool. Any of several subsets might be equally meritorious-Hthis is where selectim criteria and judgment enter 
the process. The result is a fmgram research portfolio that can be reshaped in succeeding years. 

OTA suggests that two broad criteria could be applied to research project selection: strengthening educatimi 
and human resourc;^* and building regional and instituti;xial capacity. How might these two additional criteria be 
rated in research proposals? 

• Education and human resources criteria would weigh proposals on their fiihirc production of new 
researchers or technically skilled students. Outcome measures would relate to undergraduate education, 
graduate training, and characteristics of new Ph.D.s— the number and quality of those entering graduate 
study and the research work force, respectively. 

Contributions to human resources include increasing participation in the educaticmal pipeline (through 
degree completion), the research work force, and the larger science and engineering work force. With the 
changing character of the student population, tapping the diversity of traditionally undeitepresented groups 
in science and engineering (e.g., women and U.S. minorities) is vital for the long-teim health of the research 
work force. 

• Regional and institutional capacity criteria would weigh proposals on their contribution to underpartici- 
pating regions and institutions. Outcome measures would include the enhanced reseaith competitiveness 
of funded institutions; State, local, and private participation in the support of the research infrastructure; and 
an enlarged role in training and employment in targeted sectors, industries, and fields. 

Regional and institutional capacity are important concerns in all Federal funding, reflecting the inter^^sts of 
taxpayers. While the major research universities are exemplary in their production of research, untapped 
resources could be developed in other types of educational institutions throughout the United States.^ 

Funding research to achieve all of these objectives will remain a prerogative of Congress. But decisions that 
add tomorrow's criteria to today's, especially in the review of project proposals at the research agencies, will expand 
the capability of the Federal research system. 



^If (he Federal Clovernmetit wishei to augment (he economic health of a particular region^ supporting research in that area is one means 
of Acfiieving it. "Spin-offs** from research ceniers have traditionally improved local economies by encouraging development of technical 
industries and local research inirastructures. They also often contribute to local educational efforts and directly provide technical jobs for 
residents. See U.S. Congress, Office of Technology Assessment. Hif>her Education for Science and Engineering, OTA-TM-SET-52 
(Washington. IK!: U.S. Governju^n: Priming Office. March 1989). 



priority that they cDnsidcr essential for science/'^ 
Hach ernphasi/es the separation of liu'gc projeel.s 
requiring new infra.strueture from * 'small science.** 
Press further dislinginsJies fmiuiui resources from 
national crises anil extraordinary scientific breiik- 
through.s. w[)ereas Broniley places national needs 
and international security concerns above all else.-^^ 

While the Press and Bromley tonnulations appear 
to provide ffanieworks tor priority setting, tliey do 
not address the prohlvni that theie are few meclja- 
nisnis fi>r. and no (ladilion ot. ranknig reseaicli 
topics across fieKls and sut^tields of uujuiry. In 



addition, priority setting is often resisted by tlie 
recipients of Feder-il funding because it orders the 
importance of reseaic'.i investments, which means 
that some programs do not get funded and some 
groups within the scientific community complain of 
lack of support. Consequently, Congress and the 
executive branch have found that the scientific 
community cannot make crosscutting priority deci- 
sions in science. In piu-ticular, the traditional mecha- 
nism of {X!cr review is clearly not suited to nuiking 
judgments across scientific fields. Sotne research 
communities do set priorities within specilic re- 
sem'ch iireas. However, the practice is not universal 



* Sro i'Lirik I'ri'ss. * Ok- OilvMimn .>! Ui<- ( iuMcn A>^i\" ( V'An-M'v /^f. .»ri/. Ma> I^^SX. pp lil '/^H VMM), :ind 0 All.in lUDfiiicN . " Ki'>norf 
Aiiarrs>." Ill S.iiii'f. {»p ^. It . !(HH!ji/n' II, p M ( Pus atiy.iiKMiioil hv M'S h\hn<>loyy |\>lk >.*' issut'tl h> t|ic lixt^uiivc ()f the I^oskUmii. 

Offuri*! SuciKi* .i!kI li-i lumloy.s r«»lK\. Scpl 

•'"OiK- I'MfUjil ihoNC rank. ordiMsis the- soiMumy i h'arum of «t-[Mr:iri .tv..i»ums. 1 1- . ih.tl v link os could bo made withjtj oat h c»in*>znt>' anil ihcMtatfcss 
t .il^'y.iuu s ( )t vcujr-vc MK h ^hMK<-s all* homy niado h\ v.uiniis [^irtu lp.t;•^{^ in ihi' rosoarv h s% sioin sinujllafiooiisly 
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or widespread.^^ Therefore, while recognizing the 
preferences of researchers, the Federal Government 
must set priorities at two levels: among scientifically 
meritorious research areas and megaprojects, and 
among agency programs. 

Megaprojeds and the Science Base 

Key to the consideration of allocating public 
funds for science and engineering research is the 
simultaneous support of little and big science. Little 
science is the backbone of the scientific enterprise, 
and a diversity of research programs abounds. Not 
surprisingly, many investigators and their small 
teams shudder at the thought of organizing Federal 
science funding around a principle other than 
<^cientific merit — an approach that, in fact, is advo- 
cated by no one. They fear that setting priorities 
would change the criteria by which research fiinds 
are awarded. In particular, they seem to hear calls for 
priority setting as calls to direct all of research along 
specified lines, not as a means to assure that balance 
is achieved. For example, one goal would certainly 
be the maintenance of funding for a diverse science 
research base,^^ while other goals would include 
training for scientists and engineers, and supplying 
state-of'the-art equipment. 

Tlie Federal Government also seeks to achieve 
goals at many levels. These goals are likely to differ 
between programs that pursue specific objectives 
and those that seek primarily to bolster tlie science 
base. For instance, the allocation of additional 
monies to NIH for AIDS (acquired immunodefi- 
ciency syndrome) research, beginning in the late 
1980s and continuing today, has been a clear 
designation of an objective as a priority research 
area. In addition, to enhance the science base in 
specific research areas, such as environmental sci* 
ence and high-temperature superconductivity, the 
Bush Administration has increased funding in cer- 



tain fields. These increases, however, seem to be 
dwarfed by the cost of a very few, but visible, 
megaprojects. 

Megaprojects are large, "lumpy," and uncertain 
in outcomes and cost. Lumpy refers to the discrete 
nature of a project. Unlike little science projects, 
there can be almost no information yield from a 
megaproject until some large-scale investment has 
occurred. Presumably, a successful science mega- 
project provides knowledge that is important and 
luiattainable by any other means. Because of the 
large expenditures and long timeframes, many 
science megaprojects are supported by large politi- 
cal constituencies extending beyond the science 
community.^^ Future decisions may center on r&iJc- 
ing science megaprojects, since not all of them may 
be supportable without eroding fundiiig of the 
science base (see figure 1-7). 

There are few rules for selecting and funding 
science megaprojects; the process is largely ad hoc. 
From a national perspective, megaprojects stand 
alone in the Federal budget and carmot be subject to 
priority setting within a single agency. Nor can 
megaprojects be readily compared, ^or example, the 
Superconducting Super Collider (SSC) and the 
Human Genome Project (HGP) are not big science 
in the same sense. One involves construction of one 
large instrument, while the other is a collection of 
smaller projects.^^ 

An issue raised about some megaprojects is their 
contribution to science. For instance, the Space 
Station has little justification on scientific grounds, 
especially when compared with the SSC, the HGP, 
or the E'dxth Observing System, which have explicit 
scientific rationales. On purely scientific grounds, 
tlie benefits that will derive from investing in one 
project are often incommensurable with those that 
would be derived from investing in some other.^ 



^ot cximples, %cc ihe NitionaJ Research Council, Renewirff U.S. Mathematics: A Plan for the 1990s (Wtahington^ DC; Ntlional Academy Press, 
1990); mMj ibc NaUouaJ Research CouiKil, The Behavioral and Social Sciences: Achievements and Opportunities (Wtshington, DC: National Academy 
Pre«s. 198H). 

'^ ms priority been preernii^nt since the Federal support of research began. See House Committer on Science and Technology, op. cll., footiK)lo 

9. 

^^Phil Kuni?.. "Pic in ilie Sky: Big Science Is Ready for BUutoff." Conj^ressional Quarterly, Apr. 28. 1990. pp. 1254-1260. 

'^Thc rctcarch supported by tlic Human Genome Project— HGP— may have wmc scientific benefits before the project is complete. Thu5, HGP may 
rwt be big science in (lie strict sense of the definition outlined above. See T^n Shcop, "Biology's Moon ShoU" Government pMcutive, Febmary 1991, 
pp. 10-11. 13. 16^17. 

^^For tn early statcnwnt of tills view, $cc U.S. Congress, Office of Technology Assessment, Civiiian Space Stations and the US. future in Space, 
OTA-STI-241 (Springfield. VA: National Technical Information Service. November 1984). 

^This is cUbomtcd in Harvey Avcrch. *'Anal>'7.1ng the Cosw of Federal Research,** OTA contractor report. August 1990. Also sec J.E. Sigel ct al.. 
"Allocating Resources Among AIDS Research Stialegies." Policy Sciences, vol. 23, No. 1, February 1990, pp. 1-23. 
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Figure 1-7— Cost Scenarios for the Science Base and Select Megaprojects: Fiscal Years 1990-2005 
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Doubled current cost estimates for megaprojects 
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KEY: SSC-Sup«rconduct»nfl Sup«r Col!id«f; EOS-Earlh Obwrvlng System. 

NOTE: Th«s« ligurM aro schtiTiatlc reprtMntatlons of projected costs for sdsncs projtcti. In th« figures on th« l«ft, th« td^tKm bM Is pfoJ*c1«d V> grow 
at an annual rata of 3 parc«nt abova Inflation. In tha figuras on tha right, fofa/ Fadara) rasaa/c/) fundhg Is projactad to grow 3 parcanl abova inflation. 
Tha oosl astimatas for tha magapro)acU ara basad on data from "Tha Outlook In Congr asa lor 7 Major Big Sclanca Projects." fha C/vontete of Higher 
Educiition, Sapt. 12. 1990. p. A2d. and Ganavtava J. Kna2o. Congrasslonal R^aarch Sorvlca. SciarKo Policy Rasaarcti Division. "Sdanca 
Magaprojacts: Status and Funding. Fabruary 1991," unpuWlshad bocuinant. Fab. 21. 1991. 

SOURCE: Offica of Tachnok>gy Assassmant. 1991 . 
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Phcto cr0dit: N^tlonBl Amnmtim and SpaM Admkmtrmiion 

The HubUe Spaco Telescope (HST) Is shown, still In the grasp of Space Shuttle Discovery, with only one of two solar panels 
extended. Earth Is sonne 332 nauttcal-mlles away. HST Is an example of a larse scientific 

mission at NASA. 



However, because the problem of selecting among 
science megaprojects has most in common with the 
selection of complex capital projects, timeliness 
(why do it now rather than later?) and scientific and 
social merit must all be considered, as well as 
economic and labor benefits. At present, for exam- 
ple, the Space Station has considerable momentum 
as an economic and social project. 

Other measures to evaluate and, if necessary, 
compare megaprojects include the number and 
diversity of researchers that can be supported, the 
scientific and technological value of information 
likely to be derived (i.e., the impact of the mega- 
project OL the research community), and the ultimate 
utility of the new equipment and/or facility. For 
instance, if one project will support only a few 



researchers, while a second of similar cost and 
scientific merit will support a larger number of 
researchers, then perhaps the second should be 
favored. One might also expect preference for 
megaprcj cts that can be cost-shared internationally 
over those that cannot be. (Issues of costs in 
megaprojects are discussed below*) 

Once the context for priority setting is examined, 
choices take on another dimension. What do U.S. 
society and the Federal Government expect for their 
research investment? What does the scientific com* 
munity promise to deliver? The answers differ 
among participants and over time. As Robert White* 
President of the National Academy of Engineering, 
states: ' It may be time that we think about whether 
our concern for the support of the science and 
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technology enterprise has diverted us from attention 
to how we can best serve national needs. "^^ 

Congressional Priority Setting 

Since progress begets more opportunities for 
research than can be supported, setting research 
priorities may be imperative for shaping a successful 
Federal research portfolio in the IPPOs-^*" lb im- 
prove priority setting at a macro level, Congress 
should hold biennial hearings specifically on the 
state of the research system, including cross-field 
priorities in science and engineering, and the criteria 
used for decisionmaking within the cognizant re- 
search agencies. 

For "objective-oriented" science and engineer- 
ing that may or may not cross agencies, such as 
high-temperature superconductivity research. Con- 
gress should allocate resources based on plans to 
attain specific goals. In programs that seek primarily 
to fortify the science base, such as those sustained by 
NSF, Congress could judge progress toward goals 
that reflect the research edacity of the scientific 
community. While objective-oriented programs will 
contribute to these goals, the burden falls largely on 
science base programs to meet the goal of maintain- 
ing the research community. Congressional over- 
sight of the research agencies could include ques- 
tions of how their total research activities and 
specific programs, such as multiyear, capital- 
intensive megaprojects, contribute to expanding 
education and human resources, as well as to 
building regional and institutional capacity. 

If Congress determines that more thorough and 
informed prior. 4ting is required, the executive 
branch must di«- jse the criteria on which its 
priorities were set. OSTP is a candidate for this task. 
Building on the Federal Coordinating Council for 
Science, Engineering and Technology (FCCSET) 
mechanism, which presently considers only certain 
cross-agency research topics, OSTP could also 
initiate broader priority setting. In the executive 
branch. Congress should insist, at a minimum, on 



iterative planning that results in: a) making tradeoffs 
among research goals; and b) applying (after scien- 
tific merit and program relevance) other criteria to 
research decisionmaking that reflects planning for 
the future. In addition, since megaproject costs affect 
the ability of other disciplines to start new, large 
projects, megaprojects are candidates for crosscut* 
ting priority setting.^' 

Structural improvements to current priority set- 
ting, especially those that facilitate the budget 
process and research planning within and across the 
agencies, would also make the tradeoffs more 
explicit and less ad hoc, and the process more 
transparent. At a minimum, agency crosscutting 
budgetary analysis^s and a separate congressional 
cycle of priority-setting hearings (e.g., biennially) 
could reduce uncertainty and reveal the relationships 
among new and continuing projects, the support of 
new investigators by each agency, and the changing 
cost and duration estimates that currently bedevil all 
participants in the Federal research system. 

Congress could also initiate specific changes in 
the executive agencies that would increase their 
ability to respond to changing priorities. They would 
include measures f'>.v.» encourage: 1) flexibility, so 
that programs can r ;nore easily initiated, reori- 
ented, or terminated; 2) risk-taking, so that a 
balanced portfolio of mainstream and "long-shot" 
research can be maintained; 3) strategic planning, so 
that agency initiar!/es can be implemented as 
long-term goals; 4) coordination, so that crosscut- 
ting priorities can be pursued simultaneously in 
many agencies; and 5) experimentation with funding 
allocation methods, so that new criteria can be 
introduced into project selection and evaluatexl to 
ascertain the value added to decisionmaking. 

It is symbolic that across the Federal research 
system, national policymakers, sponsors, and per- 
formers alike have acknowledged that the funding 
process would bftefit from careful consideration of 



WaihSjtwlilX: 0^1'*2 "j'^'^J*- "'"^ ^ Sorccrci » Appreullcc." Prciidential AddrcM lo the National Academy of EngincerinH. 

«Broc.kj vvrtics, "Tbday many of Uk atme negative lignals that exiited in 1971 are again evident. Will icietwc recover to experience a new era of 
projpcnty as it did begiuning iji the Ute seventies, or tuu the day of reckonijig that lo nuny predicted finally aitived?" llarvey Brookj "Can Science 
Survive in the Modern Age? A Revisit After Twenty Years," National Forum, vol. 71 . No. 4, fall 1990. p. 33. 

KepZVoll^^rg'ml ^p^m ^'"^ Big-Money Projects. ' ' Congrcsional Quarterly WteUy 

"This WW a priuc(pal rccouuiRiidation proposed in National Academy of Sciences, op. cit.. footnote 6. 
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reseiiTch priorities, especially at the macro level. 
Whether their exhortations lead to clearer research 
agendas (including the suspension or postponement 
of some activities) remains to be seen, and whether 
these investments are balanced, well-managed, and 
yield the desired consequences is hard to judge in 
real time. But surely the policy process is enriched 
by drawing a map of the choices, the benefits, and 
the costs to be incurred by tlie scientific rummunity 
and the Nation. 

ISSUE 2: Understanding Research 
Expenditures 

Summary 

Many in the scientific community claim tliat 
the '^costs of doing research" are rising 
quickly, especially that the costs of equipment 
and facilities outpace increases in Federal 
research funding. The most reliable data are 
available from research agencies, and can be 
analyzed at two levels: 1 ) total Federal expend- 
itures for research, and 2) individual compo- 
nents of research project budgets. OTA finds 
that Federal expenditures for research have 
risen faster than inflation, and more research- 
ers are supported by the Federal Government 
than ever before. Salaries and indirect costs 
account for the largest and fastest growing 
share of these expenditures. However, these 
findings do not truly address the claims ex- 
pressed above, because of the numerous and 
sometimes inconsistent meanings of tlie costs 
of doing research. 

Most research activities become cheaper to 
complete with time, as long as the scope of the 
problem and the standards of measurement do 
not change. However, advances in technology 
and knowledge are •'enabling'': tliey allow 
deeper probing of more complex scientific 
problems. Experiments are also carried out in 
an environment driven by competitic i. While 
competition is part of the dynamic of a healthy 



research system, competition drives up de- 
mand for funding, because success in the 
research environment often correlates highly 
with the financial resources of research groups. 

Direct cost containment by the research 
agencies may not be an appropriate Federal 
role, although Congress might direct the agen- 
cies to pursue specific measures at their 
discretion and to evaluate their effectiveness. 
Instead, greater cost-accountability could be 
encouraged by the executive branch and Con- 
gress. In particular, the Federal Government 
should seek to eliminate the confusion around 
allowable indirect costs, and develop better 
estimates of future expenditures, especially for 
megaprojects where costs often escalate rap- 
idly. 

Discission 

Many resejychers state as an overriding problem 
that the **cosls of doing research" have risen much 
faster than inflation in the Gross National Product 
(GNP), and Federal expenditures for research have 
not kept pace with tliese rising costs. Included in the 
costs of reseju'ch are salaries, benefits, equipment, 
facilities, indirect costs, and other components of 
research budgets. Eciuipment and facilities are typi- 
cally named as most responsible for increased 
costs. 

However, addressing tliese cla-ms is difficult, 
because it is hard to define what is meant by the costs 
of doing reseiirch. Research activities become 
cheaper to complete with time, as long as the scope 
of the problem and die standards of measurement do 
not change. But this is not the way progress is made. 
Advances in technology and knowledge are •'en- 
abling'*: they allow deeper probing of more complex 
problems, lliis is an inuinsic challenge of research. 

There is an extrinsic challenge as well. Experi- 
ment.^ are ciu^ried out in an environment that is 
driven by com{>ctition. Competition is part of the 
dyniunic of a healtliy research system. One sign of a 



*'Mn atldilion tu Ihosc citnl prrvioiisly. scf Knhon M Roscn/woi^t. Pfcsidciil. AsstK'iation of Anjei^can I'nivcrsitios. "Addrcs.s U) ihc f*TPSidcn!'s 
Opornn)^ Session. 'H'c <icronrol()j;n.;il S(K'iety of America." 4^(1 annual meeting. Hosiofi. MA. Nov U). John H [)utlon and l-iiwson ( mwe. 

•Soit'dK l*nonties Arnon>j ScienniK' Initiatives." Amtrttun Sucnnu, vol 7f». No Novcaa>er-l)cccnihcf l<3H8. pp Albert M Tc\ih, 

•'St icnlisls .uid f^uhlic Ofhuals Must Pursue Coliiiboralum lo Set Research Priorities;' The S\tcnn.u. vol. .1. No Teh *5. r»<). pp 17. and Tma M 
KiUfsbef>jand koheii I. Park. 'Scicmists Musi Tate the l^nplca-suiit ra,sk ()f Selling I'riormes. ' The ChronH le tyf Hti(hvr tUiui (tfinn vol 37 No 2 A 
Peh HJ<;|. p ASJ 

^"Sec Jankc I^m^-. "hush's leiRo AdMsot DiHUsses lKxlinin>[ Value of KA:I) Dollars." < 7u'"j/. .;/ it l.n\iineer\f\^ .Wm a. vol 68. No I 7, Apr 2 ^ 
IV««). pp 16 17. Siit'tHt Ihr f nj.'f the ir.^nticr \ op ul . fooinMic- 14. .md OlA iiiierMev^sat Ihe I'mvcrsiiy of Michiijan and Slanlord rniversilv 
JijiN August l^^m) ^ 
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healthy research system is ^hat it can expand to 
produce more research. ''Needs'' in the research 
environment are thus open-ended. 

Although competition exists in the research com- 
munity, it does not necessarily drive down costs, as 
would be expected in typical '•markets." In an 
earUer era, the chief cost of research was the annual 
salary of the principal investigator (PI). Today, the 
PI is often the head of a team with many players and 
access to the latest research technologies. In the face 
of inherent uncertainty about the eventual outcomes 
of research, sponsors must apply various criteria in 
predicting the likelihood of eventual project success, 
such as access to sophisticated equipment or the 
availability of appropriately trained personnel. 
The.se criteria are often associated with higher rather 
than lower costs. Success, therefore, often comes to 
those who spend the most (especially if research 
teams are relatively evenly matched). In fact, com- 
petitive proposals are often the most expensive and 
low bids can actually decrease a proposer's chance 
of winning a grant. Because additional personnel 
and sophisticated equipment are seen by sponsors as 
being instrumental in the conduct of research, costs 
are ultimately limited by what sponsors are willing 
to spend. 

' loducts, or * 'outputs," of scientific research 
have also traditionally defied measurement."*^ Con- 
sequently, the price of research measured in eco- 
nomic terms — the cost per-unit output — is ex- 
tremely difficult to estimate. Analysis using crude 
measures of scientific "productivity" suggests that 
the cost of producing a published paper or perform- 
ing a given scientific measurement has decreased: 
with less than double the investmeni per year since 
1965, more than double the number of papers are 
published today in academia, and more than double 



the number of Ph.D. scientists are employed in the 
academic sector.^^ By these measures, science has 
grown more productive (and consequently tlie cost 
per-unit output of research has decreased).^ How- 
ever, there is no metric to compare a "unit" of 
today's research with one in the past. 

Thus, ' * Are tlie costs of research going up? ' ' is not 
a useful question for policy purposes. Research 
expenditures by the Federal Government are 
awarded and accounted for on an annual basis. What 
gets included in these expenditures can be modified 
by adjusting the scale and pace of scientific research. 
Especially for basic research, these factors are 
variable, though the competition for personal and 
institutional recognition pushes Pis toward larger 
teams and more sophisticated instrumentation. In 
mission-oriented science, the rate of research may be 
dictated by pressing concerns (e.g., curbing the 
AIDS epidemic is desired as quickly as possible). ^ 

For policy purposes, research costs equal expen- 
ditures; if the Federal Government provides more 
funds, **costs" will go up accordingly. A more 
useful policy question might be: "Is Federal spend- 
ing on individual components of research [project 
budgets reasonable?" The Federal Government will 
tend to have a different point of view on this question 
from the research performer. OTA h s explored both 
perspectives. 

Incomplete and murky data on research expendi- 
tures complicate questions on the costs of research. 
Analysis of Federal expenditures for the conduct of 
research must factor what Federal agencies are 
willing to spend for persomiel, facilities, and instru- 
mentation, while analysis of expenditures by re- 
search performers is confounded by the expenditure 
accounting schemes that vary from research institu- 



^'Scc. for cxamp' ., Richard Nelson, "The AUocation of Research and Dcvclopnicn! Resources; Some Problems of Public Policy." Economics of 
Research and Devehpment.RicbaidTyboui (cd.) (Columbus. OH: Ohio Stale University Press, 1965). pp. 288^08. Nelson potnta out that . . research 
and development has economic value because the information permits people to do things better, and somctiroca to do things that ibcy did not know 
bow to do before. . . [but] there is no simple way to evaluate ihc benefits society can expect from the knowledge created by diffc«nl kinds of RAD. . . / ' 
(pp. 293-294). Also sec Mansfield, op. cit., footnote 3. 

^2published papers and patenu Jiave been used ss proxies, but they cannot be standardized. Sec Susan E Co/zeiw. ' 'Literature^Bascd Dau in Research 
Evaluation: A Manager's Guide to Bibliometiics." final rcpon to the National Science Foundation, Sept. 18. 1989. 

^^On ilje fomv;r. see II D While and K.W. McCain. "Bibliometrics." Annual Review of Information Science and Technology, vol. 24. 1989. pp. 
1 19-186; aiHl oil the latter. National ScietKe Board, op. cit.. footnote 12. tables 5-17 and 5-30. 

*^Howcver. even if one acccepts the.se definitions of research output, the productivity of research relative to other economic activities might still be 
stagnant. Fxronomist William Btumol explains that research due to the price of labor rather than incrca.«:s in iu productivity, has an " . . . inherent 
tendency to rise in cost and price, persistently and cumulatively, relative to the costs and prices of the economy's other ouq)uts. ' ' He warns that the 
consequence may be an impediment to adequate funding of RAD acUvity. tliat is. to a level of funding coaiisteni with the requirements of economic 
efficiency and tlie general economic welfare/* See W.J. Baumol ci aJ.. Producnvity and American Leadership: The Long View (Cambridxe. MA' MIT 
Press. 1989). ch. 6. quotes from pp. 1 16. 124. 
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Figure 1-8— Estimated Cost Components of U.& Academic R&D Budgets: 1958-88 (In billions of 1988 dollars) 




1958 1963 1968 1973 1976 1983 1988 



SOURCE: Qov0rnm«nt-Un(v«rslty*lnckJt1ry R«March Roundtabl«, Sd' 
9nc9 und Technology in th^ ActKMmic Ent9rpri$0: Stutus, 
Tr0nd$ Mndl§aum, (Wathingtorii DC; National Acad«my Prau, 
1969), f )gura 2-43. 

NOTE: Conttam dollars wara caloulatad uainfi tha QNP Impllolt Prioa 
Oaftalor. 

DEFINITION OF TERMS: Eatlmatad paraonnal ooata for nmlorBChnmta 
and gnduMte 9tud$nt3 Induda talarlaa and frln^a banaflta. such as 
Insuraooa and ratlramant contributlrna. Ctfm direct coats 
such budgat Itacns as matarlata and suppllaa, trkval, subcontractors, 
oomputar sarvlcos, puMlcattons, consultants, and participant support 
costs. Indirect costs Induda ganaral admlnlatmtlon, dapartmant 
•dmlntatfitlon,bulldlngoparatlonandmalntananoa,dapradatlonand 
usa, sponsorad-rasaaroh prpjacts admlnlatratlon, llbrarlas, and atu* 
dant^arvicas admlnlatratlon. £<}u/pmanf costs Induda: 1) raportad 
axpandit uraa ot saparataly budgstad currant funds fbr tha purohasa of 
rasaarchaqulpmant.and 2)astlmatadoapltalaxpandlturaaforflxador 
built-in raaaarch aqulpmant. FaofiitleM costa Induda aatlmatad capital 
axpandlturas forrasaarchfadlltlas. Indudlngfadlltlas oonstmctad to 
housa sdantlf Ic apparatus. 
DATA: National Sdanoa Foundation. Dlvfslon of Policy Rasaarch and 
Analysis. Databasa: CASF^R. Soma of tha data witNn this 
databasa ara astlmatas, Inoorporatad whara thara ara disoontlnul- 
tias within data sarias or gaps In data ooKaotlon. Primary data 
soufca: National Sdanos Foundation, Division of Sdanoa Raaouroa 
Studlas, "Survay of Sdantlflo and En^lnaarlng Expandlturaa at 
Unlvarsltlas and Collagas"; National Inslltutas of Haalth; Amarlcan 
Assodation of Unlvarslty Profaaaors; National Assodatlon of Stata 
UnlvarslHas and Land Qrant Coflagss. 
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tion to research institution.^^ In addition, much of 
the current debate over rising expenditures takes 
place within a context of agency budget constraints 
and pressures felt by research performers. 

The most reliable data on Federal research expen- 
ditures are availabV? from research agencies, and can 
be analyzed at two levels: 1) total Federal expendi- 
tures for research, and 2) individual components of 
research project budgets. OTA finds that total 
expenditures on individual components of grants 
have risen over inflation, but not nearly at the rate for 
total Federal expenditures for research (see figure 
1-8). Instead, growth in the size of the research work 
force supported by the Federal Government seems to 
account for the largest increase in Federal research 
expenditures. Also, the largest component increases 
of rCvSearch project budgets arc for salaries and 
indirect costs. 



Trends in Components of Total 
Federal Research Expenditures 

Analyzing Federal expenditures for specific line 
items of research budgets ""eveals interesting trends 
(again see figure 1-8). First, reimbursements for 
indirect costs are the fastest growing portion of 
Federal research expenditures. Indirect costs is a 
term that stands for expenses that reseaich institu- 
tions can claim from the Federal Government for 
costs that cannot be directly attributed to a single 
research project, i.e., they are distributed over many 
investigators who share research infrastructure and 
administrative support. Federal support for indirect 
costs has increased since the 1960s, with the largest 
increases in the late 1960s and the 1980s. In 1958, 
indirect cost billings comprised 10 to 15 percent of 
Federal academic R&D funding. By 1988, that share 
had risen to roughly 25 percent.^ In addition, some 
agencies allow more than other agencies in indirect 
costs. For example, in 1988, the indirect cost as a 
percent of the total R&D expenditures allowed at 



^^For an attempt to compare cxpcrulitures at two public and two private univenities ajsocuted witli the performance of NationtJ Science 
Foundation-fuixled research, ^eG W. Baughmao* "Impact of Inflation on Research Expenditures of Selected Academic Disciplines 1967-1983/* report 
(o the National Science Foundation and the National Center for Educational Statistics, NSF/PLN 8017815. Nov. 8. 1985. Also see Daniel E. Koshland, 
"The Underside of Overhead," Sctfnce, vol. 249, May 1 1» 1990, p. 3, and "The Overhead Question,' ' letters in response to Koshland*s editorial, Science, 
vol. 249. July 6» 1990. pp. 10-13. 

**NatioiuiJ Science Foundation, The State of At adftnic Saence and En}(inecnng (Washington, DC: 1990)» p. 121. 
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These scientists are In an Ion beam laboratory at the 
University of Michigan. Research often requires state-of* 
the^art equipment 

NIM was 30 percent, whereas it was less than 24 
percent for NSF (a proportion unchanged since the 
mid.l980s).-^7 

Second, increasing numbers of investigators and 
rising salaries (and the benefits that go with tl>em) 
have driven up the price of the personnel component 
of direct costs. University personnel speak of tlie 
increased competition for faculty with other sectors 
of the economy, and note that faculty salaries have 
been rising significantly over inflation during the 
last decade. Tlie average total compensation (sala- 
ries and benefits) for academic Ph.D.s in the natural 
sciences and engineering increased from $59,(X)0 



(1988 dollars) Li 1981 to more than $7(),0(X) in 1988, 
In the same period, tlie number of full-time equiva- 
lent scientists and engineers employed in academic 
settings rose steadily from about 275,000 to almost 
340,000-^ 

Third, Federal support for academic research 
equipment alone increase4 from $0.5 billion in 1968 
(1988 dollars) to $0,9 billion in 1988. Despite 
pronounced increases and improvements in equip- 
ment stocks in the 1980s, 36 percent of department 
heads still describe their equipment as inadequate (to 
conduct state-of-the-art research). This is in part due 
to the reduction in the obsolescence time of equip- 
ment and instrumentation use since the late 1970s.^^ 

Finally, the Federal share of all capital expendi- 
tures for academic facilities (which include both 
research and teaching facilities) has never topped 
one-third. Now it is less than 10 percent-^^ For 
university research facilities alone, the Federal 
Government provided an estimated 11 and 16 
percent, respectively, of private and public univer- 
sity capital expenditures in 1988-89. The govern- 
ment also supports research facilities through depre- 
ciation, operation, and maintenance charges 
accounted for in the indirect cost rate. In 1988, the 
Federal Government supplied nearly $1 billion to 
support university infrastructure. Almost 20 percent 
was for facilities depreciation, while the rest was 
recovered for operation and maintenance cosis,^^ 

Academic administrators claim that with growing 
frequency, aging laboratories and classroom build- 
ings falter and break down,^^ and many claim that 
facility reinvestment has not kept pace with growing 
needs. However, the picture is not clear. For 
example, when asked by NSF, a majority of the 
research administrators and deans at the top 50 



*^bid., p. 142; and Association of Americiui Universities, Indirfct Costs Associated With !^edtral Support of Research on University Campuses: Some 
Suggestions for Change (Washington, DC: December 1988). 

^Govcrnmcnt-Univcrsily-Industry Research Roundlable, Science and Technology in the Academic Enterprise: Status, Trends^ and issues 
(Wtiliiogton, DC: National Academy Press, October 1989). pp. 2-34 and 2-47, based on National Science Foundation data. 

^^ational Science FoundaUon, Academic Research Equipment in Selected ScienceJ Engineering Fields: 1982^3 to 1985-86, SRS 88-Dl 
(Washington, DC: June 1988). 

»For public universities. 50 to 60 percent of the faciUtics funds con>e from the Stales, and 30 percent from bonri issues . For jHivale universities, roughly 
oue-third coraes from the Federal Government, while another one-third is from donations. See Michael Dt.vey, Briclts and Mortar: A Summary and 
Analysis of Proposals to Meet Research Facilities Needs on College Campuses (Washington, DC: Congitsslonai Research Service. 1987). 

5^0ver the period 1982 to 1988, the Federal lupport of university intnutpt^mrc! grew by over 70 percent in real terms. These figures are presented 
in **Enhancing Research and Expanding the Human Frontier." op. cii., footnot/j 16, pp. 61-62. The docunkcnt further tutes that: ''Each academic 
institution must provide a certification that iu resea/ch facilities arc adequate (to perform the research proposed) as a condition of accepting research 
grants."The*\ . $12 billion of needed, but unhanded capital projects — ''reported in the National Science Foundation surveys of univcnities'V . has 
not had an apparent effect on the ability of universities to accept Federal research funds." 

5*arcn Grassniuck, ' 'Colleges Scramble for Money to Reduce Huge Maintenance Backlog. Estimated to Exceed $70 Billion; New ftdct^ Help Seen 
Unlikely.'* The Chronicle of Higher Education, vol. 37. No. 6, Oct. 10. 1990, pp. Al. A34. 
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research universities replied that their facilities were 
••good to excellent/' whereas a majority of the 
research administrators and deans in the schools 
below the top 50 estimated that their facilities were 
••fair to poor."^^ 

The crux of the facilities problem is that research 
and academic centers can always use new or 
renovated buildings, but how much is enough? Even 
though '^nced" may not be quantified in the 
different sectors of the research enterprise, a demand 
certainly exists. For example, when NSF solicited 
proposals for a $20 million program in 1989 to 
address facilities needs, it received over 400 propos- 
als totaling $300 million in requests.^"^ 

Federal Policy Responses to Increased Demand 

Many Federal agencies have experimented with 
grant-reducing measures, such as the salary caps 
required by Congress and temporarily imposed by 
NSF and NIH, the ceilings on indirect costs currently 
in place at USDA, the elimination of cost-blind 
reviews of proposals in some research programs at 
NIH, the limitation of funds supplied in new grants 
to researchers with multiple Federal grants at the 
National Institute of General Medical Sciences, and 
the institution of fixed-price grants in some NSF 
programs.^^ Congress could pursue permanent 
grant-reducing measures to slow or limit increases in 
research expenditures on individual research grants. 
However, it may not be an appropriate Federal role 
to dictate specific allowable costs in rese^u'ch 
j)rojects. In general, allowing maiket forces to 
determine costs has been a tradition in Federal 
policy. 

Instead, greater cost-accouiitabiiity could be en- 
couraged. One benefit of cost-uccountability could 
be incentives for pcrfomiers to spend less than what 
was targeted in project budgets, and greater flexibil- 



ity in expenditures for perfomiers (e.g., researchers 
could be encouiaged to use the money saved one 
year in the next year, a so-called no-cost extension). 
Within such cost-accountability measures, Congress 
might also direct the agencies to experiment with 
cost-containment schemes and to evaluate their 
effectiveness. 

Greater cost-acountability is especially important 
in the calculation of indirect cost rates. At present, 
the guidelines for calculating costs are detailed in 
conjunction with 0MB Circular A-21 and have been 
in force since 1979. Every major research university 
has an indirect rate established for the current fiscal 
year for recovery of costs associated with sponsored 
research. These rates have evolved over many years 
as a result of direct interaction and negotiation ivith 
the cognizant Federal agency. There is a wide rauge 
of indirect cos^s rates among universities, with most 
noticeable diftcrences between public and private 
institutions (rates tend to be higher at private 
institutions). Rates vary because of: 1) significant 
differences in facilities-related expenditures, 2) un- 
derrecovery by some universities, 3) imposition of 
limits by some government agencies in the negotia- 
tion process, and 4) diversity in assigning compo- 
nent expenditures as direct or indirect.^ 

However, confusion around what is contained in 
the indirect cost rate is getting worse, not better. This 
reflects, in part, the difficulty of separating expendi- 
tures along lines of research, instruction, and other 
functions.^"' Recent investigations by the Office of 
Naval Research and the House Committee on 
Energy and Commerce have also uncovered signifi- 
cant variation in the accounting of indirect costs by 
the cogni/ant Federal agencies and reseaich univer- 
sities.^^ ITiese differences .should be sorted out, and 
more explicit and understandable guidelines de- 
vised. 



'^National Science Foundalion. Sciennfu atui En^mtenna Rf starch Ftuiltnes a ' Universitifs and CoUejues. J9HH, NSF 88-320 (Wasliiiigton. DC: 
Scpicnibcr m^l p. 26 

^-^Scc Jcffr crvis. "Imiiluiioiis Rcspoad m Large NunihrniioTiny FaciliUosPrognuna' 4IH. NSF/* T/ir 5n>n/m. vol. 4. No. S.Apr. 16. 1990. 

p 2 

^^For adjscussion of various optioas, %fic. Barbard J. Culiilon. "NIH Readies PlaM for Cost Containnicnt/* Scifnce, vol. 250, Nov. 30. 1990. pp. 
1 108 1 1'>9, and Colleen C^.tics, * Universities Fear 'l"ha> U S Will Linui Payments for Overhead Costs Incurred by ReAcarclicrs.'* The Chronicle of 
Hifther liducatio/u vol 37. No 3. Nov 2l» 1990. pp. A19. API. 

^A.'-.srvianon of American Universities, op cit . footrwtc ^ ?. 

^^Fleanor C TJioimts and l^ionard L. Ijcdeiman. National Scipncr FouiMjaiioii. Directorate for Scienufic. Technological, and Imcnulinnal Affairs. 
'MiKlircct Costs of Federally Fuiulod Academic Research.*' uiivubh.siicd p^jwi. Aug. 3. 1984, p. 1. 

'••See Marcia flaimaga. ^'SLinford Sails Into a Stonn.'* Science, vol. 2.S0. Dec. 21. 1990. p. 1651; ' Govenxnienl IrKjuiiy.** Stanford Observer, 
Novcmbcr-Doccinbcr 1990. pp i 1 3. Colleen Cordes. *'Concedi»>s! 'Shortcomings.' Stanford lb I^orgo S5OO.0(X) in Overhead on U S Contracts.** The 
Chronicle of Higher Education, Jan 30. ^C^l, vol 37. No. 20. pp Al9, A22; and Collc«n Cordes. **Staiiford U. Bmbroilcd ir. Angry Controversy oc 
OvcrfwadClmigcs.'* The Chronnol of Hiaher Education, Feb ft. 1991. vol. 37. No 21. pp. Al. A20-A21. 
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It is also important to stress accuracy in develop- 
ing estimates of costs for megaprojccts. When the 
Federal Government ** buys'* a megaproject, the 
initial investment seems to represent a point of no 
return. Once the go, no-go decision has been made 
at the national level, the commitment is expected to 
be honored. However, criteria for consideration in 
the funding of a science megaproject could conceiv- 
ably include: startup and maintenance costs, cost of 
unanticipated delay, cost of users' experiments, and 
likely changes in the overall cost of the project from 
initial estimate to completion. Some estimates for 
science megaprojccts double before the construction 
is even begun, and costs of operating a big science 
facility once it is completed .ve sometimes not 
considered.^^ 

Megaprojccts will always be selected through a 
political process because of their scale, lumpiness, 
and incommensurability. Since their costs, espe- 
cially in following years, uffect other disciplines' 
abilities to start new, large projects, megaprojccts 
could well be considered as candidates for crosscut- 
ting, priority-setting analysis before the practical 
jviint of no remrn. As the National Academy of 
Sciences' report on budget priorities reminds; 
* . . . it is necessary to specify the institutions, 
individuals, and organizations that will be served; 
[and] the costs ... of the program."^ The cost of 
investment for the Federal Government is an impor- 
tant criterion to apply to all scientific research, 
including megaprojccts. 

Performer Expectations 

Not all problems in rcrearch costs cr.* be ad- 
dressed by the Federal Government. Many research- 
ers point to higher executions, which require more 



spending, and competition in the university environ- 
ment. In the academic environment, researchers are 
asked today to publish more papers, shepherd more 
graduate students, and bring in more Federal funding 
than their predecessors.^^ If they do not meet these 
expectations, some report a sense of failure.^^ This 
is true even if they have succeeded, but not by as 
much or as quickly as they had hoped. 

To boost research productivity and to compete 
with other research teams, faculty attempt to lever- 
age their time with the help of postdoctoral fellows, 
nontenure track I'^searchcrs, and graduate students 
who are paid less/^r salaries. Due to the shortage of 
faculty positions for the numbers of graduate stu- 
dents produced, young Ph.D.s have been willing to 
take these positions in orac/ to remain active 
researchers. This availability of * 'cheap labor" is 
seen by many senior researchers and their institu- 
tions as the only way they can make ends meet in 
competing for grants. This is a trend toward an 
''industrial model," where project teams are larger 
and responsibilities are more distinct within the 
group.^ While the expenditures charged to an 
individual grant may be less (since more grants may 
be required to support the diverse work of the group), 
the overall cost of supporting a PI and the larger 
group are greater.^*' 

Some experiments have been attempted on U.S. 
campuses to emper the drive for more research 
publications (as a measure of productivity )> For 
exa.nple, at Harvard Medical School, faculty are 
alk wed to list only five fl||blications for considera- 
tion in tenure reviews, wan similar numbers set for 



'^For example, sec Kuniz, op. cit.. footnote 31; aad Davi'^ P. lianiiJton, ' The SSC T^kcs oti a L^e of Its Own/' Science, voJ. 249, Aug. 17, 1990. 

pp. 371-372. 

National A£di\cxny of Scieiice.s, op. cit, fi)oUK>te 6. p. 11. 

^>71us \% espcciully true in entrrpreiieunal resejuch nrw such as biotechnology. See Heniy Btzicowit/. "Entrepreoeuhai Scientists and GotrepreiieuriaJ 
Uiiivcrsitiei in American Academic Scieocc," Minerva, vol. 21, suinmcr-autunm 1983, pp, 198-233. 

^'Science : The End of the Frontier? op. r .,., footiidtc 14. 

^l^bor economist AUn ^^echler. Kxc^ativc Dlreetor. Office of •'cicntific a:id Engineering Personnel. National Rese^h Council, writes; 

. . f«rsonDcl costa constitute roughly 45 percent of total costs and . . . this percentage has rcrojiincd reasonably suble over lime. Given that salaries 
of faculty (i.e., principal invcsiigatoi) have br a rising during the 19808, this sugg- ats that the staffing pattern of research projects has been changing, 
with rhe input of Pis decreasing relative to . . other, less expensive resources. I*h6' e is sonv evidence to support this hypotJicsis in the report of GUIKK 
(Govemnjeni-'iniversity^Iiidustry Research Rounduble) .(that) firjds in 'cademia an iiirrcasing raiio of nonfaculty to faculty." personal 
communicatioi Nov. 15. 1990 See Govcrnjncnt-Univcrsi«y-lndusiry Resear' a Rouiidlable. op. cit., footiwtc 48. 

'^♦Elsewhere this has been caMed the "industrialization'* of science, or " a new collectivized form in which characteristics of both the acadcnnc 
and ind'jsrrulized nKMJ^'s are inlenninglctj.*' See John Zlman. An introduction tc Science Studies (Cambndge, England: Qunbridgc University Prc.*is, 
1984). p. 132 (elaborated below). 

^Noicd at OTA Woiltstop on the Costs of Research and Federal Decisioianaking, July 19. I99() 
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other promotions.*' Thus, the quality and iinpor- 
tunce of the candidate's selected set of papers is 
stressed, though measuring these ch{U'acteristics 
remains controversial.^^ However, strong incentives 
militate against reducing reseiu-ch volume. Most 
overhead is brought into the university by a small 
number of research professors. (At Stanford, 5 
percent of the faculty bring in over one-half of tlie 
indirect cost dollars.) Any measure that would 
reduce grant awiu-ds and publications produced by 
these investigators would deprive the university of 
revenues. In fact, many universities in tight financial 
straits try to maximize the level of reseaich volume .^^ 

Tlie Federal Government must seek to understand 
better the trends in expenditures in the rcsciych 
environment — es[)ecially viu-iations across institu- 
tional settings — and craft government policies to 
allocate resources effectively. Reliable analyses of 
research cxjx^nditures at all (^f the Federal agencies 
are not available. Future studies of ex{xjnditures 
should look not only at the economic forces tlial 
increase (and decrease) research expenditures, but 
also at the sociology of research organizations, 
includnig the demography of research tccuns and 
institutional policies for sponsored projects/*'^ 

Federal agencies clearly must understand increas- 
nig demands to fund research, as reseaich universi- 
ties and laboratories are an invaluable resource for 
the United Stales. Devising mechanisms for coping 
with research expenditures is one of the ccniral 
challenges to the Federal system for fuiiding re- 
seiuch in the WOs. 

ISSU(; .'i: Adiiptinj^ [.ducMtion and Human 
K(^S()Lirc'(^s Ic) Mvv\ C hcingin^ 
Nvvds 

Summary 

Three issues are central to education and 
human resources for the research work force: 

1. Recent projections of shortages of Ph.D. 
reseaichers in the mid-1990s have spurred 



urgent calls to augment Ph.D. production in the 
United States. OTA believes that the likeli- 
hood of these projections being realized is 
overstated, and that these projections alone are 
poor grounds on which to base public policy. 
For instance, they assume continued growth in 
demand in both academic and industrial sec- 
tors, independent of the level of Federal 
funding. In both this and previous OTA work, 
however, OTA has indicated the value to the 
Nation — regardless of employment opportuni- 
ties in the research sector — of expanding the 
number and diversity of students in the educa- 
tional pipeline (K-12 and undergraduate) for 
science and engineering, preparing graduate 
students for career paths in or outside of 
research, and, if necessary, providing retrain- 
ing grants for researchers to move more easily 
between research fields. 

2. Total participation in science and engi- 
neering can be increased if the opportunities 
and motivation of presently underparticipating 
groups (e.g., women, minorities, and research- 
ers in some geographic locations) are ad- 
dressed. Federal legislation has historically 
played an important role in recruiting and 
retaining these groups. Also, ''set-aside" pro- 
grams (which offer competitive research grants 
to tiugeted groups) and mainstream discipli- 
iViXry programs are tools that can enlarge, 
sustain, and manage the diversity of people and 
jistinuions in the reseaich system. 

3. ResciU'ch in many fields of science and 
engineering is moving toward a larger, more 
* industrial" model, witli specialized responsi- 
bilities and the sharing of infrastructure. In 
response, the Federal Government may wish to 
acknowle<lge changes in the composition of 
research groups and to enliance the opportuni- 
ties and rewards for postdoctorates, nontenure 
track researchers, and others. 



N.Uioim' Si iiMur h)uiii!.itii>ii .jKo luuv hrunx \hc MuniK*r o\ puhhi .iHoda ii will coii.suliT. .iscvKloiKoof aiiapplu am \ track record, m reviewing 
^laiH priipns.ils Si'o P haiiiillnii. "inihiishin>( Hy aihlhor* (lie NuiuKts." .S'M<vh vol 2^0. Dec 7. lt>9<K pp n'^M^^2 

'^'Soo N I ( loilfi rf al . ■■( iffium* (*it;il»on kales Id ( ■(Mnp.ire S^. lorlH^Is' Work. " .Sf^c ml Si ivm e He^eufi h, vol 7. No 4. |<)7K. pp VtS and A I. 
I'orUT el at . "('!Mh^u^^ anil SoofHilK J^oyross ( oinpanriK HiHiornetiK Me.i.Nuro'; W ilh Soenitst JuiiK"ients " .Sc /r^i^vm^-rnM vol \\ no 
lot IM * 

^UlA iiileis u v.'* .It SLijilurd ('{luorsiK. Any ^ V l'^*>n 

'♦''See Susan f < 'n//rfjs el ai « euts >. / >i( /('(•sr.i/. S s v/r'M <'j / /.</m; /^ "'i. t V ^ eitlin>'s <)f .» N A I U A(jv ani C(t Shidy la^ltluk^ M < *UK t( Italy ik\ I W 
r^KW (I>of(lK\hi. MtHlaii.l Muuer \'f'K\) 



ERIC 



3- 



BEST COPY {^mm 



Chapter 1— Summary and Issues for Congress • 29 



Discussion 

The graduate science and engineering (s/e) educa- 
tion system in the United States, especially at the 
doctoral level, is the envy of the world. Foreign 
nationals continue to seek graduate degrees from 
U.S. institutions at an ever-growing rate.'^^ From 
1977 to 1988, the number of Ph,D.s awarded in s/e 
by U.S. universities increased by nearly 50 percent*^^ 
(for a breakdown by field and decade, see figure 
1-9). This exemplary production of Ph. D.s continues 
a noble tradition abetted by Federal research and 
education legislation. 

With passage of the National Defense Education 
Act of 1958 (Public Law 85-864) in the wake of the 
Sputnik launch, the Federal Government became a 
pivotal supporter of pre- and postdoctoral science, 
engineering, and indeed, non-s/e students.'^^ Addi- 
tional programs were soon established by NSF, 
NASA, NIH, and other Federal agencies. This period 
of growth in Federal programs offtving fellows hips 
(portable grants awarded directly to students for 
graduate study) and traineeships (grants awarded to 
institutions to build training capacity) was followed 
by decreases in the I970s7^ In s/e, this decline was 
offset by the rise in the number of research 
assistants hips (RAs) for students awarded on Fed- 
eral research grants to their mentors. 

During the 1980s, RAs became the principal 
mechanism of graduate s/e student support, increas- 
ing at 5 percent per annum since 1980, except in 
agricultural sciences where RAs hav^ actually de- 
clined. (A comparison of tlie types of graduate 
student Federal support, 1969 and 1988, is presented 



in figure 1-10.)^* This trend is consistent with tlie 
growing ''research intensiveness'' of the Nation's 
universities: more faculty report research as their 
primary or secondary work activity, an estimated 
total in 1987 of 155,000 in academic settings.^^ 

Thus, the Federal Government has historically 
played both a direct and indirect role in the 
production and employment of s/e Ph.D.s. Both as 
the primary supporter of graduate student stipends 
and tuition, and as a patron, mainly through research 
grants, the Federal Government has effectively 
intervened in the doctorate labor market and helped 
shape the research work force. 

Supplying the Research Work Force 

The U.S. graduate research and education system 
trains new researchers and skilled personnel for all 
sectors of the Nation's work force (and arguably for 
some countries abroad). Since 1980, NSF estimates 
that the total s/e work force (all degrees) has grown 
at 7.8 percentper year, which is four times the annual 
rate of growth in total employment. Scientists and 
engineers represented 2.4 percent of the U.S. work 
force in 1976 and 4.1 percent in 1988. ''^ 

While new s/e Ph.D.s have traditionally been 
prepared for faculty positions in academia — almost 
80 percent were employed in this sector in 1987''^™ 
in broad fields such as engineering and disciplines 
such as computer science the demand for technical 
labor outside of academia is great. Other field^s, like 
chemistry, benefit from having a large .set of 
potential academic and industrial employment op- 
portunities. This diversity makes any labor market 



'^Scc Naiioiul Science Board, op. cii.. footnote 12. p. 55; and National Research Council Foreign andForeif^n-Bom Engineers in the United States 
(Waishington. DC: NaUonaJ Academy Press. 1988). AJihough OTA uses the sbortlitnd "sdcnlists and cnginccn." it recognizes the riuigc of fields 
represented by the term. They are encompassed by ihe degree-granting categories in tlic National Science Foundation's vScicoce Resources Studies 
reports: engineering, physical sciences, environnkJntal sciences. malbemalicaJ sciences, computer/information sciences, life (biological/agiicultural) 
sciences, psychology, atMl social sciences. 

'^National Science F^oundation. Science and Engtneenng Doctorates. 1960^9, NSF 90-320 (Waslunglon. EX:: 1990). ubie 1. 

^For details, sec U.S Congress. Office of Techiwlogy Assessment, Demographic Trends and the Scientific and Engineering Work Force. 
OrA-TM-SET'35 (Washington, DC: U.S. Government Printing Office. December 1983). pp. 4449. 

^Association of American Uni /eraities. The Fhl>, Shortage: The Federal Role (Washington, DC: Jan. 1 1, 1990). pp. 15-16. 

'^If plotted by gender, this figure would look quite different. Traditionally, women have not received as many feUowships and traineeships as men 
or foreign students on temporary vis^?. are more dependent on persoiul or fanUly resources during graduate study, and suffer higticr attrition before 
completing the Phi> See U.S. Congress. Office of Technology Assessment. Educating Scientists and Engineers Grade School to Grad School. 
OTA-,SB r.377 (Wailiington. DC: U.S. Government Printing Office. June 1988). pp. 79-80; and National Science Poundution. Women and Mi non ties 
in Science and Engineering. NSF 90-301 (Washington. DC: January 1990). pp. 23-24. 

'^National Science Board, op. cit., foouwte 12, pp. 46. 57. Tlicse 153.000 represented 37 pcrcejii of the doctorate scientists and en^ineeis eiML^oyed 
in the United States in 1987 ' 

"'^Ibid., p 67 Amofig Ph.D s. the ratio of employed srjentiAtA to engineers is 5 to I. 
T^lbid.. app. table 5-19. 
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Figure 1-9— Percentage Distribution of Doctorates by 
Science and Engineering Field: 1960*89 (by decade) 

Percent of all doctorates earned 
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SOURCE: National Science Foundation, Sd^ncB and EnginB^rlng Doctor- 

afes; 1960 89, NSF 90-320 (Washington, DC: 1990). detailed 

ttattstical tables, table 1. 



fluid and its forecasting difficult, but the major 
components can be analyzcd.^^ 



Figure 1-10--Federal Support of Science and 
Engineering Graduate Students, 1969 and 1988 
(by type of support) 



In percent 



lOOi 



80 i 



60 ^ 



40: 



20 



Fellowships — ^ 
Trameeshlps— 




Research 
assistantshipa 



Teaching 
assistantshlpsv^. 
Other 
* support 



1969 

Total 
students 
supported: 51,620 



1988 



64.652 



100 



80 



160 



■40 



20 



NOTE: Fellowshipe and tralneeehlps were not reported Mparelely In 1969, 
SOURCE: National Science Board, Sd9nc« mnd Enginrnming fndicMtor9^' 
1939, NSB 89-1 (Washington, DC: U.S. Government Printhg 
Off Ice. 19e<>\ appendix table 2-18; and National Sdence 
Foundation. Graduafe Student Suppori Mnd Manpower Ha^ 
sourcas In Graduata Scianc^ Education, fall 1969, NSF 70-40 
(Washlnflton DO: 1970). table C-1 la. 



Based on cluiiiging demographics and historical 
trends in baccalaureate degrees, some studies have 
projected that the scientific community will face a 
severe shortage in its Ph.D. research work force 
during the 1990s7^ However, there are pitfalls in the 
methodologies employed in these projections of 
Ph.D. employment demand. Predicting the de- 



mand for academic researchers must also account for 
enrolJment and immigration trends, anticipated ca- 
reer shifts and retirements, and the intentions of new 
entrants, as well as shifting Federal priorities and 
available research funding. All of these are subject 
to change, and may vary by institution, field, and 
region of tlie country In addition, OTA questions 



?»For examples, see Eileen L. CoUins. "Meeting llic Scientific and Technical Slaffing Requirements of the American V^onomy r Science and Public 
Policy, vol. 15. No. ?i . October 1988. pp. 335-342; m<l National Rcsean:h Council, The Effect.^ on Quality of Adjustments in Engineering Ubor Markets 
(Washington. DC: National Academy Press. 1988). 

^Sec Richiifd C. Alkiiwoa '^Supply and Demand tor Scientists and Engineers: A National Crisus in the Making.'* Science, vol. 246, Apr. 27. 1990. 
pp 425-432. 

*oindccd. shortages rnay not be the biggest concern Giai^ges in demographic composition and quahty of graduates may be more problematic. For 
a discussion, sec Howard P. 1\jckinan, "Supply. Human Capital, and \\\c Average Quality Uvel ol a^c SciciKe and Engmecrmg Ubor Force/* 
Economics of Education Review, vol. 7. No 4. 1988, pp. 405-421. 

•>Por example. .»ee Ted 1 .K . Youn. * 'Studies of Academic Markets and Careers An Historical Review.* ' Academic Ubor Markets and Careers. D.W. 
Brenenuiii and Ted l.K. Youn (cds.) (Philadelphia. PA. The Falmer Press. 1988). pp 8-27. 
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the ability of statistical analyses to predict future 
demand for s/e Ph.D.s, espeuaUy as responses to 
market signals and other societal influences are 
known to adjust both interest and opportunities. 
Even without the prospect of a slackening economy 
in the 1990s, such projections would be unreliable. 
Given the track record of these forecasting tools, 
they are poor grounds alone on which to base public 
policy. ^2 

Noting the uncertainty of projections, OTA finds 
that concentration on the preparedness of the pipe- 
line to produce Ph.D.s (i.e., increasing the number of 
undergraduates earning baccalaureates in s/e) by 
introducing flexibility into the system is tiie most 
robust policy. If shortages begin to occur in a 
particular field, not only should graduate students be 
encouraged to complete their degrees (i.e., reducing 
attrition), but prepared undergraduates should be 
induced, through various proven Federal support 
mechanisms, to pursue a Ph.D.^^ Those scientists 
who would have otherwise left the field might stay 
longer, those who had already left might return, and 
graduate students in nearby fields could migrate to 
the field experiencing a shortage. If shortages do not 
materialize, then the Nation's work force would oe 
enhanced by the availability of additional highly 
skilled workers. 

OTA believes there are initiatives that maintain 
the readiness of the educational pipeline to respond 



to changing demands for researchers and that 
enhance the diversity of career opportunities — 
sectors and roles — ^for graduates with s/e Ph.D.s.^ 
Congress could urge NSF and the other research 
agencies to intensify their efforts to maintain a 
robust educational pipeline for scientific researchers 
(and to let the labor market adjust Ph.D. employ- 
ment). Funding could be provided for undergraduate 
recruitment and retention programs, for grants to 
induce dedicated faculty to teach undergraduates, 
and for the provision of faculty retraining grants*^*"^ 

Expanding Diversity and Research Capacity 

Trends in the awaid of s/e degrees attest to 20 
years of steady growth in human resources (see 
figure 1-*11). These data are a sustained record of 
scientific education at the Ph.D. level. However, the 
benefits of this education do not accrue equally to all 
groups, and therefore to the Nation. Women and 
U.S. racial and ethnic minorities, despite gains in 
Ph.D. awards through the 1970s and 1980s, lag the 
participation of white males. Relative to their 
numbers in both the general and the undergraduate 
populations, women and minorities (and the physi- 
cally disabled) are underparticipating in the research 
work force.*^ Meanwhile, foreign nationals on 
temporary visas are a growing proportion of s/e 
Ph.D. recipients (and about one-half are estimated to 
remain in the United States).^'' 



•^OTA reached this conclusion after c*ac joiug Ihc pcrfomumcc of various modeli of academic and indwtrial labor markeW. Sec Office of Technology 
A-ssessracnt. op. cil.. footnote 72. especially chs. 3 and 4. Recent independent confimiation of this conclusion tt|)peajs in Alan Rchter. "Engineering 
Shoruges and Sbortfails: Myths and Realities." The Bridge, fall 1990, vol. 20. pp. 16-20. 

•VSee Office of Technology Assessment, op. cit., footnote 74. 

•*See two reports: U.S. Congress. Office of Technology Assessment, Eiemtntary and Secondary Education for Science and Engineering, 
OTA-l M-SET-41 (Washington. DC: U.S. Government Printing Office. December 1988); and Higher Education for Science and Engineering, 
OTA-TM-SKT-52 Washington, DC: U.S. Government Printing Office. March 1989). 

'^The National Science Foundation, as prescribed in their enabling legislation, is equally responsible for science education and the support of the 
Nation's basic research. It has gradually expanded its programs, long focuied on the graduate end of the pipeline, to address issues in undergraduate 
and K- 1 2 education. For example, see National Science FoundaUon, Research on Key Issues in Science and Engineering Education: Targeted Program 
Solicitation. NSF 90-149 (Washington, DC: 1990). Perhaps faculty retraining programs, both to highlight changes in educational strategics and 
developments in research, should be coasidercd. Retraining has been acknowledged as important for maintaining the engineering work force, and 
retraining grants have been provided in some programs within the Department of Defense and other agencies. Additional research retraining grants could 
certainly be financed by tlie research agencies and perhaps administered through the Federal laboratories. Retraining for teaching wouM fall primarily 
to universiUcs that wish to improve the classroom (i.c.. undergraduate) teaching of its faculty. Sec National Research Council, op. cit., footnote 78, and 
Neal Lane. "Educational Ciallenges and Opportunities," Human Resources in Science and Technology: Improving U.S. Competitiveness, Proceedings 
of a Policy vSymposium for Government. Academla, and Industry. Mar. 15-16. 1990. Wasliington. DC. Betty Vetter and Eleanor Babco (cds,) 
(Waslrngton, DC: Commission on Professional in Science and Technology, July 1990), pp. 92-99. 

•^Degrees alone tell an incomplete story of future supply of scientists and engineers. For caanjple. college attendar^e rates of 1 8- to 2 1 -year-olds vary 
by gender and race. Since 1972. 35 to 40 percent of whiles of both sexes in the cohort have attended college with Black rates in the 25 to 30 percent 
range. By 1988. female attendance exceeded that of males and was risinj?, whereas male attaidancc of both races peaked in 1986-87 and declined 
thereafter. See National Science Board, op. cit., footnote 12, p. 50. figure 2-2. 

*^For an overview, see Comm»5.sion on Professionals in Science and Technology. Measuring National Needs for Scientists to the Year 2000. Report 
of a Workshop. Nov. BQ-Dec. I. 1988 C\V'ashington, DC: July 1989). pp. 20-24. For more on graduate engineering education, see Elinor Barber ei al., 
Choosing Futures. U S ami Foreign Student Views of Graduate Engineering Education (New York, NY: Institute of International Education, 1990). 
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TTiese students are in a lat)oratory at tho University of 
Michigan. Laboratory classes are a cruda) part of 
undergraduate education In the physical sdenoes. 

Increasing the participation at all c<iucational 
levels in s/e by traditionally underrepresentcd 
groups is a challenge to the human resources goals 
of the Federal research system. Enhancing the 
participation of targeted! groups at the Ph.D. level 
will be particularly difficult, as the research work 
force adjusts to changing fiscal conditions ana 
funding of research. As OTA foimd in an earlier 
study, . . equal opportunity for participation in 
higher education and in research for all groups is a 
long-term social goal that will be achieved only with 
steady national commitment and investments/*^^ 
Congress could amend the Higher Education Act 
(reauthoriziition is scheduled for the 102d Congress) 
and the Science and Engineering Equal Opportuni- 
ties Act to add provisions that address diversity in 
research and science education funding, and empha- 
size undergraduate teaching opportunities at certain 
categories of institutions such as historically Black 
colleges and universities (HBCUs).^^ Programs 
targeted to U.S. minorities, women, and the physi- 
cally disabled could help to expand the pool of 
|K)tential scientists and engineers. It is clear that in 
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grees: 196&d3, A Source Book, NSF ©0-312 (Waahinglon. DC: 
1990), ciotailod statlatical tables. tabl« 1. 



•*Oftlcc of Tcchzjology A.iscsinienl, op. cil , foolnole 74, p, 10 1 

•'^For (tie scope of cunoit provisjons. sec Margol A. HcJiciict, Coiigrcssioiul Rcscarcti Service. "Higher Education: Reauthorization of tlie Hi^^her 
Eiiucation Act" Issue Biicf. SUy 15, 1990; and iniblic Uw 9<>-5 16, 94 Stat. 3010. Section U, Science and Engineering Equ-aJ OpportuiuUe* MU Part 
ax auKiKled by Public Uw 99 159, 1982. 
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this particular realm of human resources, market 
forces alone will not increase the participation of 
these groups. Policy intervention is required and 
Congress is empowered to intervene. 

The capacity of the research system could also be 
augmented by encouraging **have-not'' institutions 
to concentrate excellence in select research pro- 
grams (departments and centers) and build f^om 
there. Attempting to enter the top ranks of federally 
funded research-intensive universities through 
across-the-board enhancement of all research pro- 
grams may lead to each program being unable to 
garner enough support to improve research capabil- 
ity. Various programs that address geographical 
diversity, such as the NSF Experimental Program to 
Stimulate Competitive Research (EPSCoR), or 
greater consideration of geography in funding allo- 
cation within the portfolios of mainstream scientific 
merit-based programs, could build research capacity 
that benefits States and regions as well as the Nation 
as a whole. 

Research and Education in Flux 

Calls for the refonn of higher education in the 21 si 
century are now emanating from many presidents of 
research universities.^ These calls center on im- 
proved undergraduate education and a better balance 
between research and teaching. Many see a need to 
change ttie reward system of the university, since 
asking universities to augment the teaching of 
undergraduates may be misplaced if faculty continue 
to view this a.s a drain on time that would be better 
spent doing research.^* 

The tension between research and teaching is 
perpetuated by the provision of funds meant to 
improve both the institution's research perfomiance 
and teaching capability. A common perception 
during the 1960s was that Federal dollars that 
supporteu reseiu-ch also benefited undergraduate 



teaching because these top researchers would com- 
municate their excitement about developments ''at 
the laboratory bench** to undergraduate and gradu- 
ate students alike. In die 1980s, with the separation 
between research and undergraduate education be- 
coming more pronounced, the connection between 
research progress and the cultivation of human 
resources grew more tenuous.^ These calls for 
increased undergraduate teaching by faculty seek to 
alter an academic research and teaching model in the 
United States that is akeady under strain. 

The predominant mode of academic research in 
the natural sciences and engineering begins with a 
research group that includes a PI (most often a 
faculty member), a number of graduate students, one 
or several postdoctoral scientists, technicians, and 
perhaps an additional nonfaculty Ph.D. researcher. 
While this group may be working on a single 
problem funded by one or two grants, subsets of the 
group may work on different but related problems 
funded simultaneously by multiple project grants. 
(In the social sciences, the groups tend to be smaller, 
often numbering only the faculty member and one to 
two graduate students*) 

In addition, the dominant model to launch a career 
as a young scientist is movement from one research 
university to another with an assistant professorship, 
the attainment of a first Federal research grant, and 
the re-creation of tlie mentor *s professional lifestyle 
(e.g., independent laboratory, graduate students, 
postdoctorates). For an institution to subscribe to 
this model tends to shift much of the actual 
responsibility for awarding tenure from the depart- 
ment faculty to the Federal Government. While 
university officials say there is **. . .no fixed time in 
which researchers aie expected to become self- 
sufficient through outside grants . . . researchers 
who have failed to win such grants are less likely to 



**f*roniinerit among llicm .\ic ihc two lastilulioos ihat O VA stu<liwl oNpart ofWm assessment, Stanford and Michigan. Sec Kuen Grassmuck, "Some 
Research Universities Contemplate Sweeping Change.^ Ranging From Management and Tenure to Teaching Methods." The Chronicle of Higher 
£diuation, vol. 37, No. 2. Sept. 12. 1990, pp. AI. A29-31. 

''•llii.s would iriciudc nothing less than a redefinition of faculty scholar.ship liiai includes teaching. Sec Ernest L. Boycr. Scholarship Reconsidered: 
Pnonnes of the Professoriate (Princeton. NJ: Ihc Carnegie Foundation for the Advancement of Teaching. 1990). Also see Alliance for Undergraduate 
Education, The Freshman Year in Science and Engineerinj^: Old Problems, New Perspectives for Research Universities (University Park, PA: 1990). 

"^Sce Anthony B. Maddoxatkl Rcnce P. Smith- Maddox. "Developing Graduate Scliool Awareness for Engineering and Science: A ModcV Journal 
of Negro Education, vol. 59, No. 2, 1990. pp. 479-490 Thii connection wa.s also highlighted wlien ia^titutioa'5 of higher education receiving Federal 
a.ssisianc€ were required to provide ccriain mfoniution on graduation rates, reported by prograra and field of study. See Public Law 101-542, Title 
I— Student Right-To- Know. Suit. 2.181 2384. Nov. 8. 1990. p. 104 
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Seventh graders observe research In a "deanroom." Seeing science at work Is Important for all age groups. 



earn tenure than their colleagues who have found 
such support. 

There is doubtless a role for universities to play in 
the diversification of research careers of recent 
Ph.D.s. New Ph.D.s find it difficuh to entertain 
alternative opportunities if they have no experience 
with them. Thus, progrjims that offer a summer in a 
corporate laboratory or part of an academic year at 
a 4-year liberal arts college can help advanced 
graduate students visualize working in settings other 
than the university. Arrangements that link an 
HBCU or liberal arts college to a research university 



or national laboratory stretch the resources and 
experience of both participating institutions.^ 

New Models: University and Federal 

Other models of education could be encouraged 
that feature a greater sharing of resources (e.g., 
equipment and space) and people (e.g., doctoral 
students, nonfaculty researchers, and technicians). 
Models that stress research in units other than 
academic departments, research in nonacademic 
sectors, and nonresearch roles in academia could be 
entertained. Some Federal research agencies already 



*\Scc Dcbra II Blum. * * Yomigcr Scienlisis Feel Big Pressure in DilUc for Onutls/ ' The Chronicle ofHif^her Education, vol. 37. No. 4. Scpl. 26, 1990. 
p A16. Aj one researcher puis ii: "Le«ding univenilics should nuke their own dccisioas aboul who ihctr facuJly arc going to bc« and nol leave it to 
tl)c study sectioas of NIH." Quoted in David Wheeler. ••Biocnedical Re^archers Seek New Sources of Aid for Young Scicoliits," The Chronicle of 
Higher Education, vol. 36. No. 42. July 5. 1990. p A23. 

*^1b date, such arrangements have been nK>il common in undergraduate engineering. One coalition, spearheaded by a 5-ycaf $15 million NationaJ 
Science Foundation grant, v^ll estabUsh i comniunicaiions network for inforaiation disscminatioo, faculty exchange, workshops, and outreach to 
elementary, secondary, and community college students TTie panicipaiing unlvenities are City College of New York. Howard. Maryland. Massachusens 
Institute of Technology. Morgan State. Pemwylvama Slate, and Washington. See "NSF Announces Multi-Million Dollar Grants to Fonn Engineering 
Education Coalitions." ^5^ News, Oct, 9. 1990. 
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recognize the development of this form of teamwork 
in their funding programs and support of the research 
infrastructure. For example, these models are institu- 
tionalized in the centers programs sponsored by 
NSR Centers, which support individud researchers 
(as faculty and mentors) as well, may represent a 
new way of doing business for NSF. Centers are also 
featured at NIH intra- and extramurally; at the 
laboratories affiliated with DOD, DOE, and NASA; 
and at the agricultural experiments stations funded 
through block grants by USDA,^^ 

Research in general is becoming increasingly 
interdisciplinary, i.e., it requires Jie meshing of 
different specializations to advance a research 
area.^ Academic departments house specialists by 
discipline whose research will be performed in 
units — centers, institutes, programs — that cut across 
the traditional departmentid organization on cam- 
pus. Such organized research units have a history on 
U.S. university campuses, but not as dominant 
structures.^^ However, as outlined above, in many 
fields there is movement toward an industrial model 
of research, characterized by larger research teams 
and a PI who spends more time gathering funds to 
support junior researchers who in turn devote their 
full time to research. For many of today's research 
activities, this model seems to enhance productivity 
and allow more complex research problems to be 
tackled, by specializing responsibilities within the 
research team and sharing infrastructure.^® 

The expanding size and complexity of research 
teams under the responsibility of entrepreneurial Pis 
and **lab chiefs'' fosters financial and organiza- 
tional strains. To help ease the strains caused by a 
transition in some parts of the research community 
to an industrial model, the Federal research agencies 
could encourage alternative models of education-in- 



research that feature a greater sharing of resources 
and people. While it is not the role of the Federal 
Government to dictate university research or educa- 
tion policies, it can provide the impetus for examin- 
ing and experimenting with those policies through 
grant support. 

Mainstream agency programs have always 
awarded research fiinds to advance the state of 
knowledge in their programmatic areas mainly on 
the core criterion of scientific merit." Though 
difficult to define precisely, this is generally taken as 
a necessary condition for funding. Recognition that 
discipline-based agency programs favor investigator 
track record in proposal review, but that other factors 
reflect important objectives of research funding, led 
to the creation of set-aside programs. These pro- 
grams, originating both in Congress and within 
agencies, restrict the competition for scarce funds 
according to some characteristic of the investigator 
or the proposal. Set-aside programs thus evaluate 
proposals first and foremost on scientific merit, but 
redefme the playing field by reducing the number of 
competitors. (Examples discussed in the full report 
include NIH's Minority Biomedical Research Sup- 
port Program; NSF's aforementioned EPSCoR. 
Presidential Young Investigator, and Small Grants 
for Experimental Research programs; and the Small 
Business Innovation Research programs conducted 
by various Federal agencies.) 

Taken together, such programs address the com- 
petitive disadvantage faced by young, minority, or 
small business research performers; by researchers 
and institutions in certain regions of the Nation; and 
by ideas deemed **high-risk" by expert peers or that 
do not fit with traditional disciplinary emphases. 
The proliferation of such programs over the last 20 
years has been a response to the desire to enlarge 



it^^^^ Foundation lupportcd 19 Engineering Resetrch Ccntcn and 1 1 Science and Technology Research Cene« (STCs) 

at $48 milhon and K7 mi^hon^ respectively. TTius, together they account for lest than 10 percent of the National Scienc^Foundation "fcSS^^^ 
^d'^ 2 S r ^T^^^ ^ interdiKipUnary and high-risk projects oriented to the applied, developm^ and c^SiIu^ 

end of the research conunuum. See Joseph Pale* and Eliot MarihaU. -Bloch Leaves NSF in Mainstream/ 'X^m:^ vol 249 Aua 24lSo n 830 
to the Wock-grant, mulU-lnvesUgator approach emlKxiied by STC«: ''NSF has rolled the dice on an e^m i^^^^^ e^'^ 
SiSfe^l^p S^^^ wiihawinner.- See Joseph Palca, ' Welters Rise Above the StorSTTci.^^^ 23UaaTl99'.^9^^^^ 

P * '"f^^L^A^' ^"^Pr^ ?.f ^ of Cross-Disciplinary RcMWttu- Sciemonutrics. vol. 8. 1985. pp. 1 61-176; and Don 

E. Kash, Crossing the Boundaries of Duciplines/' Engineering Education, vol. 78. No. 10. November 1988. pp. 93-98. ^ ^ 

^D.1L Phiinps and B.P.S. Shen (eds.). Research in the Age of the Steady^State University (Boulder. CO: Wfestview Press. 1982). Three models of 
organ^re^chimiu(whtchaieco 

/^^^^^ '"^'^ See Robert S. Friedman and Renee C Friedman, -^ence AmSstyle: l^^Z 

inAcademc.- /'t>//0'*?'M<^^^ vol. 17. fall 1988. pp. 43-61. -^wiv«uaiyic, mrocv-a^irti 

.rr^Z^^ cit foottiote 64. pp. 132^139. In other words, the traditional academic model of faculty-mcntor plus graduate student U today 
S^Tphy^i^^^^ sharina-what has long been common, for cample. SZuo^^X.io^Z 
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both the p;irticipation in, and the capacity of, the 
Federal research system. But because the annual 
funding for each program remains modest (typically 
in the $10 million range), program impact is limited. 

Without set-asides, the Federal Government 
would have little confidence that once scientific 
merit has been demonstrated, other differentiating 
criteria would be applied to the funding of research- 
ers. However, to a reseiuch system already strap{X!d 
tor resources, the funding of such ^'tangential" 
concerns is seen by some as diverting precious 
dollars away from the core need to advance kn 1- 
edge.'^'^ 

Human resources i\rc perhaps the most important 
component of the reseiu-ch system. Through support 
of sci'^nlists and engineers, graduate students, and 
the educational pipeline, the Federal Government is 
mstrumental in the creation of a strong research 
work force, which has been expanding under this 
support since the 1950s. In the 1990s, however, the 
research work force — in its myriad forms of organi- 
zation and scale of effort — has reached such a size 
that it feels strain under the Federal Government's 
present approach to supporting the conduct of 
reseiu-ch. In addition, accommodating to an expand- 
ing research work force, and to the changing etlinic 
and rac al com(H)sition of students in the educational 
pipeli'iC for science and engineering, poses chal- 
len^'js to the Federal research system. Human 
re>ources issues have implications not only for the 
n unbcr of p;uticipanls in the research W(^rk force. 
Kut also for >hc chtyacler of the research that new 
entrants automatically bring to the Natitni's research 
enterprise. 

LSSUL 4: Kefinin^^ Datci Qjlk'c:tion and 
Analysis To Improve Ki^soarcfi 
l)(H isionnuikin^ 

Summary 

Data collected on the health of the Federal 
research system — dollars spent for reseiu'ch, 
enrollments, and academic degrees awarded in 
specific fields, and outcome measures such as 
publications and citations — are extensive. In 



other areas, however, data are scarce. For 
instance, almost no consistent information 
exists on the size and composition of the 
research work force (as opposed to the total 
science and engineering work force), or what 
proportion is supported by Federal funds 
(across agencies). 

Most research agencies, with the exception 
of NSF and NIH, devote few resources to 
internal data collection. Consequently, most 
analyses must rely on NSF and NIH data and 
indicators alone, potentially generalizing re- 
sults and trends that might not apply to other 
agencies. Furthermore, it is not clear how 
agency data arc used to inform research deci- 
sionmaking, as some challenge current policy 
assumptions and others are reported at inappro- 
priate levels of aggregation. 

OTA suggests additional information that 
could be collected for different levels of 
decisionmaking, concentrating in areas of pol- 
icy relevance for Congress and the executive 
branch. However, better information may not 
be cost-free. The idea is not merely to add to 
data collection and analysis, but to substitute 
for current activities not used for internal 
agency decisionmaking or external account- 
ability. Refined inhouse and extramural data 
collection, analysis, and interpretation would 
be instructive for decisionmaking and manag- 
ing research perfonnance in the 1990s* 

Discussion 

Many organizations colled and analyze data on 
the rcseiuch system. First and foremost is NSF. with 
its numerous surveys, reports, and electronic data 
systems that are publicly available Certainly the 
most visible cur tj>endium of dala on tlie research 
system is the biennial report. Science & Enf^ineerin^ 
Indicators (SEI), issued since 1973 by the National 
Science Board, thf* governing bculy of NSF.^^^^ Other 
sources include the other Federal research agencies; 
the National Research Council; the Congressional 
Research Ser^vice; professional societies, especially 
the American Associatit for the Advancement of 



■h.uj>!c V (Ulu s roMiriii.ilK aiu! a( Iho margins o( ihc cmcrprisc Hut il one wcrt* von.strucling Itic sysien) Irofn strjtch. rnain.Mfoaminii cnrcna lo 
ffJIcu Uir fiMiidplo f'hj(\ lives nl fcsL\t/Lh 'undmy wtiuld bo a koy clcfntriit it) tunsi(lo( 

' *Sci' Sus.ui l*. (■i)ivcn>. SuciKO !n(lK:Uf»rs Dcsvriphon or l*rosi r ipiuin OlA ».(MUran(>r ro(>ori ^opicin^or I^)^) Nolo ihai Stwtue 
I n\'f\rt'n*\\i inJi(ii(fr\ (Sr.I) w.ts ii.uncii Si irnt r tnJu^tt>r\ until )')K7 Ml \^\\\\iU <»n dal.i (.olk^icd. {»ut'ii otl. :wul issued in nuiiiy uihcr reports t' 
b\ (he SLieme HeN»»un.es Sludies DiMsiofi (»t ihe .Salmiutl Sviefke l*oun<la(u)n 
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Science; and other public and special interest 
groups.^^^ 

Tbgether these databases and analyses provide a 
wealth of information: time series on the funding of 
research and development (R&D); expenditures by 
R&D performer (e.g., universities and colleges, 
industry, Federal laboratories), by source of funding, 
and by type (basic, applied, or development); 
numbers of students who enroll in and graduate with 
degrees in s/e; characteristics of precollege science 
and mathematics programs and students in the 
education pipeline; and size, sectors of employment, 
and activities of the s/e (especially Ph.D.) work 
force. Detailed analyses of the Federal budget by 
research agency are available each year, and impacts 
on specific disciplines and industries can often be 
found. 

These publications provide a basis for under- 
standing the Federal research system. But even with 
each of these organizations devoting significant 
resources to the collection of information, better data 
are needed to guide possible improvements in the 
system. With its establishment, NSF was legisla- 
tively authorized as the Federal agency data liaison 
and monitor for science and technology.'^ Data can 
be used to monitor, evaluate, anticipate, and gener- 
ally inform decisionmakers — both within agencies 
and within Congress. Although many data are 
already collected, they are rarely matched to policy 
questions. Other (or more) data could improve 
decisionmaking. 

Information for Research Decisionmaking 

OTA defines four categories of data that could be 
useful in decisionmaking: 1 ) research monies — how 
they are allocated and spent; 2) personnel — charac- 



teristics of the research work force; 3) the research 
proces^how researchers spend their time and their 
needs (e.g., equipment and communication) for 
research performance; and 4) outcomes — the results 
of research. Besides the considerable gaps and 
uncertainties in measures of these components, the 
most detailed analyses are done almost exclusively 
at NSF and NIH, and not at the other major research 
agencies. These analyses may not generalize 
across the Federal research system. Comparable data 
from all of the agencies would be very useful to gain 
a more well-rounded view of federally supported 
research. 

Perhaps the most fundamental pieces of informa- 
tion on tlie research system are the size, composi- 
tion, and distribution of the research work force, and 
how much is federally funded. Varying definitions 
pose problems for data collection and interpretation 
(for an example, see box 1-C). These data are 
important to understand the health and capacity of 
the research system and its Federal components. In 
addition, there is evidence that research teams are 
changing in size and composition. This trend is also 
important to measure since it affects the form and 
distribution of Federal funding. 

Second, information is needed on expenditures 
(e.g., salaries, equipment, and indirect costs) in 
research budgets; for all research performers — 
academia, Federal laboratories, and industry; and by 
subfield of science and engineering. Data on how 
Federal agencies allocate monies within project 
budgets could also be compiled, and would illumi- 
nate how funding decisions are m^de within the 
research agency and would help to clarify funding 
levels in specific categories of expenditures. Better 
cost accounting and forecasting for megaprojects is 



'^^For example, sec Nalional Research Council Surveying the Nation's Scientists and Engineers: A Data System for the 1990s (Washington, DC; 
National Academy Press, 1990). Under muItiageiK:y support, the National Research Council is well known for collecting, aiuiyztng, and disseminating 
information on Ph.D. recipients. For a statement of its crosscuning role, see National Academy of Sciences, The National Research Council: A Unique 
Institution (Wasliington^ DC: National Academy Press, 1990). For a summary of major daubases on science and engineering (individuals and 
instimtions), see National Research Council, Engineering Personnel Data Needs for the 1990s (Washington, DC: National Academy Press» 1988), app. 
A-2. 

^^*For example, (he Govenunent-Univr.nity^lndustry Research Rounduble of the National Academy of Sciences, with data compiled by tlie National 
Science Foundation's PoUcy Research and AiuUysis Division, provided much useful analysis on the state of academic RAD and changes since the early 
1960s. Governmeni-lndustry-University Research Roundtable, op. cit., footnote 48. 

^^^Thcsc efforts must also be seen in the context of the massive Federal data system. The components most relevant to research arc the data series 
compiled and reported by (he Census Bureau, the Bureau of Economic Analysis* the Bureau of Labor Statistics, and the National Center for Education 
StatLMics. 

i^For Qic scope of these data collection and analysis responsibilities, see GnglarKl, op. cit.. footiK)te 8. app. 1 

>^^For example, the National Institutes of Health sets aside 1 percent of its research budget for research evaluation and internal analysis of the 
investigators and programs it supports. The Department of Energy, the Natioiul Aeronautics and Space Administration, the Office of Naval Research, 
arKi the National Scieiwe Foundation have all cofkluctcd ad hoc mhouse evaluations of die research they support and (he ediciency of the opcrationi 
needed to select and manage various research portfolios. 
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Box How Many ''Scientists'' Are There? 

How one defines a ••scientist/' **enginecr,'' researcher/* or ••postdoctoiate" is in the eye of the t)ehoWcr. 
Depending on what data collection naethod is used, counting scientistt and engineers (S/E*s) can leiult in ndically 
different estimates.^ 

Mfnitlon Numb^ 

S/E's m the U.8. wof1( force (defined by job held) 5,300,000 

8/E's in academla (defined by responses to surveys in aoademlo institutions) 712*000 

8/E Ph,D,s m tos«tereseafoh-«« sectors (defined by responses to surveys of f^.D.s) 187,000 

S/E Pti.0.s m acidemia, wttere research is either their prirmryof $0pond§ryf^ activHy 

(defined by responses to surveys of Ph.D.s) ^**'555 

8/E l>t)<D.s In teaforesearoh in aoademla (defined by reponses to surveys of Ph.^^^^ 68.000 

Fut'tfm equMJent 8/E investloatore in Ph.D. Institutions (e.g.t two researchers who each spend 

hatf -time on research would be counted as one full-time equivalent 8/E investigator) 89.000 

None of these definitions is the ''right*' one. Rather, the appropriate definition depends on the puipose for 
which the nundier is to be used Throu^mtt this report* OT^ 

e.g., by paiticipation in the U.S. work force, by sector of employment, by woric acUvity, by field, by highest 
degf«e earned. Hie reader should keq) in mind that the numbers can change by tenfold or nx»e depmding on 
who is counted as a scientist or engineer. 



^Most of fbc foUowii^ noflabcn m tatai from the Nttiooal Sckace Bo«d» Sdince A Engifnerbit l(Mcmor§^989, NSB S9*l 
(Wuh^igtoo* DC: 1989),iadsrel9S7or 19SSestiiDfttesbytheNstk^ 

nunto of fsU-iime equivaleot faivesiJpton is based oq snalysU by the Nitdoasl Scieoce FovadiMloo's PisUcy KMtidi aod Aatfysis 
EHviskm, «s repotted in GovmiDeot«U&ivcntiy-lDdoitry Reiearch RovaduMe, Scitnet and Technoloi:f tn ihiAaidimUBmefprtu: Siams, 
Trends, and issues (Waihiogtoo. DC: Natioiud Academy Prest, October 1989), p. 2*51. 



surely needed. Continuous upward revisions of cost 
estimates for rnegaprojects disrupt decisions about 
their future funding priority. 

Tliird, data on the reseiu*ch process could be 
improved in amount and kind. One U-end (mentioned 
above) that OTA has noted, mostly with anecdotal 
evidence and inferences from analyses of ex{)cndi- 
turcs, is the increasing size of research groups, botli 
within tlie university sUiicture and tlirough Federal 
support of centers. This U'end has policy implica- 
tions for the cost of rese;irch, its interdisciplinary 
capabilities, the changing demographics of llie work 
ftnce, and the aspirations of young researchers. It 
also retlccls how researchers may spend tlieir time. 
More data on '^production units'' in research, and 
their dependence on Federal funding relative to other 
sources, would augment enroUment, Ph.D. aw;u*d, 
and work activity data. Oianges in the .structure of 
production units have also influenced the research 
process and the vc^lurne— and fxrrhaps the chiirac- 
tcr™of outcomes. Information on the reseiU'ch 



process would yield a firmer foundation on which to 
base funding allocation decisions, specifically: 1) 
how researchers spend their time, 2) movement of 
research teams toward a more industrial model in the 
allocation of responsibilities, 3) changing equip- 
ment needs and communications technologies, and 
4) requirements and average time to attain promo- 
tions in tlie scientific work force. 

Evaluating Research Outcomes 

Because of the fundtunental and elusive nature of 
resCiU-ch, measuring its outcomes— in knowledge 
and education — is very difficult. The most elusive 
outcome is cultural enrichment — the discovery and 
growth of scientific knowledge. As 0MB Director 
Richard Darman has said (speaking of the proposed 
Moon/Miirs mission): "No one can put a price on 
uplifting the Nation." Research has resulted in many 
benefits and is funded precisely for this reason. This 
kind of benefit is neiu*ly imfH).ssiblc to measure. 
However, there ;u*e some proxies. 



'••^Ihr roloot l.i>>nnilory (.ha-f or w:u\\ loacior cornbtnos oruroprcnounal ami a(inmjislraijvc/su{K*rvi.sor> la.sk.s Boili are essential lo the fundiiijg iind 
U»rjgcvti> ol iho prcnlui. nvo rescardi unil Oti the ercieryf^'tKe t)l the enireprenrunal rnle oi\ canipus. sec HlvJcowii/. op. cil . fwilnolc 61 
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When looking at research as a contribution to 
education, numbers of degrees can be tallied and 
assertions made about skills added to the Nation's 
work force. When looking at research as creating 
new knowledge, one tangible * 'output'' is papers 
published by scientific investigators to communi- 
cate new information to their scientific peers. 
Communicating the results of scientific research to 
colleagues through publication in the open literature 
is considered to be an important feature of good 
research practice. Perhaps the best approach is to 
construct workable indicators and include a rigorous 
treatment of their uncertainties. 

One tool that has been vigorously developed for 
measuring the outcomes of research is bibliomet- 
rics — the statistical analysis of scientific publica- 
tions and their attributes. Intrinsic to sciertific 
publication is the referencing of earher publifhed 
work on which the current work is presumably based 
or has utilized in some way. References arc a 
common feature of the scientific literature, and bv 
counting how often publications are cited, biblio- 
metrics can arrive at a weighted measure of publica- 
tion impact — not only whether publications have 
been produced, but also what impact those publica- 
tions have had on the work of other scientists. 

OTA has explored several examples of new data 
sets that could be compiled using bibliometrics,'*^ 
First, universities can be ranked according to an 
output or citation measure — the citation rates for 
papers authored by faculty and others associated 



with each institution.^*' Institutions can be ranked 
by total numher of cited ps^rs, the total citations 
received by all papers associated with each institu- 
tion, and the ratio of number of citations to the 
number of publications, namely, the average cita- 
tions per cited paper. This appears to be a more 
discerning measure than either publication or cita- 
tion counts alone. 

For example, a ranking of institutions by average 
citation rates can be used in conjunction with the list 
of top universities, in Federal R&D funding re- 
ceived, to link inputs with outputs. Tbgether, these 
measures illuminate differences in rank.'*^ Not only 
can publishing entities be analyzed, but so c£.n fields 
of study. For instance, ''hot fields," in which the 
rate of publication and citation increases quickly 
over a short period of time, can be identified and 
''related fields,'* in which published papers often 
cite each other, can be mapped.^ Because of 
problems of interpretation in bibliometric analysis, 
it should be seen as "value-added'* to research 
decisionmaking, not as stand-alone information. 
Bibliometrics could be used to help monitor out- 
comes of research, e.g., publication output and other 
information from tlie research system.^ 

Criteria that go beyond bibliometric data could be 
specified for such evaluations. Tliese criteria could 
include the originality of research results, the 
project's efficiency and cost, impacts on education 
and the research infrastructure, and overall scientific 
merit. Such research project evaluation could be 



>^'For example, see Leah A Lievrouw. "Four Re«eafch Progranis in Scicrnlfic Communication;' A'/wwW^^ in Society, vol. I. summer 1988. pp. 
6-22; and David L. Hull. Science as a Process: An Evolutionary Account of the Social and Conceptual Development of Science (Chicaao IL Umvcr«ifv 
of Chicago Press. 1988). r j ^ - -7 

'^•RescArchcrs in western Europe have been particularly active diuing the 1980s. For example, see B.R. Martin and J. Irvine. Research Fortsight 
(London. England: Pinter, 1989). and A.FJ. van Raan (ed.), Handbook of Quantitative Studies of Science and Technology (Amsterdam Holland 
Nonh-HolUnd. 1988). a-r v . . 

^wintCT)fcting citation patterns remains a subject of contention. For cavcau. sec D.O. F-dge, **<JuantiUtive Mcaiurts of Communication in Science: 
A Critical Review." History of Science, vol. 17. 1979. pp. 102-134. The defmillve overview U contained in Eugene Garfield. Citation Indexing Its 
Theory and Application in Science, Technology and Humanities (New York. NY: John WiJey A Sons. 1979). 

'•oSee Henry Snu': and David Pendlebury. "Federal Support of Leading Edge Research: Report on a Method for Identifying Innovative Areas of 
Scientific Research and Their Extent of Fedciml Support,*' OTA contractor report, February 1989. and Henry Small. * 'Bibliometrics of Basic Research." 
OTA contractor report, September 1990. 

'"The analysis below is based on InsUtute for Scientific Information daubases and :»vj»il. op. cit.. footnote 1 10. 

« '^As pan of the agenda for future exploration, instimtions receiving primarily directed fund, or block grants (e.g.. in agriculture) could be compared 
with those that are invesiigator-initiated. This comparison would help to test the chum that targeted appropriations (e.g.. earmarking) lead to the 
production of infenor research. For discussion, see ch. 5 of tJic full OTA report. 

»'^F6r example, see Angela MarteUo. '•GoverumenU Led m Funding 1989-90 'Hot Papers' Research.'* 7/i^ Scientist, vol. 4. No. 16. Auk 20 1990 
pp. 20-23. ® 

"<See U.S. Congress. Office of Technology Assessment. Research Funding as an Investment: Can We Measure the Returns? OTA-TM-SET-36 
(Washington. DC: U.S. Govermncnt Printmg Office. April 1986); and Ciba Foundation, The Evaluation of Scientific Research (New York. NY: John 
Wiley A Sons. 1989). For evidence on U.S. research performance relative to seven other industrialized countries, see "No Slippage Yet Seen in Strength 
of U.S. Science." Science Watch, vol. 2. No. 1, January/February 1991. pp. 1-2 
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A Research Triangle Park scientist aooessas a computer 
network. Computers can Qreatty enhance data collection 
and presentatton. 

employed to augment agency decisions on funding 
and administration of leNearch programs. (Some 
research agencies already utilize certain aspects of 
research program evaluation."'^) 

Utilizing Data for Research Decisionmaking 

In a policy context, information must be presented 
to those who aie in positions to effect change by 
allocating or redirecting resources. In the diverse 
structure of the Federal research system, research 
decisions are niade at many levels. For example, an 
agency program manager requires data specific to 
the purview of his/her program, while 0MB and 
OSTP must be aware of trends in science that Jipan 
broad field.i. inst^^itiors, and agencies, as well u.s 
those iliat apply uly to f;pecific fields, perfomiers, 
and resciirch sponsors. 



Drawing on NSF vixpertise as the possible coordi- 
nating agency, infor.Tiation could be collected at 
each agency on proposal submissions and awards, 
research expenditures by line items in the budget, 
and the size and distribution of the research work 
force that is supported (including the fu".^5 • that 
this work force receives from other sources). Infor- 
mation must be available to decisionmakers for 
evaluation as well as to illuminate significant trends. 
Often data can be presented in the form of indica- 
tors, e.g., comparisons between vari ables, to suggest 
patterns not otherwise discernible. NSF has pio- 
neered and sustained the creation of indicators for 
science policy and has recently suggested monitor- 
ing several new indicators (e.g., indicators of pro- 
posal success rates, PI success rates, and continuity 
of NSF 5upport),^*<5 

OTA agrees that new indicators could be very 
useful, and also suggests elaborating them. These 
could include measures of the active research 
community (which would calibrate the number of 
researchers actively engaged in reseiirch), rnd pro- 
duction units (wUch would track trends in the 
composition of research teams by broad field and 
subfield). 

The combination of such indicators would give a 
more precise estimate of the changing parameters of 
the Federal research system.^*'' This information 
would be invaluable to policymakers concerned 
about the health of certain sectors of the system. Tb 
produce such infomiation, as part of ongoing agency 
data collection and NSF responsibilities for collation 
and presentation, extra resources would be needed 
(at least in the near term). Over time, plans could be 
developed fo streamline NSF data and analysis 
activities, such as a rwiuction in the number of 
normiandrued reports issued annually, or expansion 
of it:, inhousc and extramural **research on re- 
search." The idea is not merely to ac^d to data 
collection and analysis, but to substitute tor current 
activities that are not used for internal agency 



' ^ 'I'or cxwiiplc, sec U S Departnicr.r of F.ncrgy, Office of F»rogram Aiwiysis, Office of Energy Research, ^4 n Assessment of the Basic Krtergy Sciences 
f^wgram, DOE/l:R-Oi23 (Washington. \yC' 1982). F'or a review of other evaluationii, tct Natiofitl AcAderay of f icncca. Committee ou Science, 
Iliigjnccring, and Public Policy. The Quality of He search m Science fWatshington, DC: National Academy Press, 1982). app. C. 

i^'^Nttiionai SciciKc Foundation. "NSF Vital Signs: Treads in Research Support, Fiscal Years 19SO-89.'* draft rcpojt, Nov. 13. 1990. Some of the 
uKlicnonj repoitcd hrf«» v/cre used for an inhouse National Science Fouiwlation evaluation of ways to streamline the workload of program staff and the 
external research commujuty. See National Science Foufldation, fiepori of the Merit Review Task Force, NSr 90-1 13 (Wtshingloa DC: Aug. 23. 1990). 

' ^ ^For example, what would be the indicatioas that growth in research productivity is slowing or that the size of a research commurUty is precariously 
large or snudl relative to tlic resources supporting ii? See Colleen Cordes, "Policy Expciis Ask a Heretical Question: Has Academic Science Grown 
Tbo Big?" The Chronicle ofHiffher Education, vol .V/. No. 3. Nov. 2K 1990. pp. Al. A22. 



ERIC 



Chapter 1 — ^ mn ary and Issues for Congress • 41 



decisionmaking or external accountability* If 
there is a preniium on timely information for 
research decisionmaking, it must be declared (and 
funded as) a Federal priority. 

Congress could in^^truct every research agency to 
develop a baseline of information, direct NSF to 
expand its focus and coordinating function for data 
collection and analysis, and direct OSTP (in con- 
junction with 0MB) to devise a plan to incr^^o^,. the 
reporting and use of agency data in the budget 
process, especially crosscutting infoi matron in pri- 
ority research areas. Using the FCCSET n'lcchanism, 
this has ah-eady been done for global change, 
high-performance co.nputing, and most recently, 
science and mathematics education.^ This mecha- 
nism seems to work and could be more widely 
emulated. 

In summary, better data on the Federal research 
system could be instrumental in the creation or 
refinement of research policies for the 1990s. (For a 
summary of data oriented to different usei.s, see table 
1 -5 ) The utility of data, of course, is judged by many 
participants in the system: the needs of Congress are 
usually agency- and budget-specific the agen- 
cies, in contrast, worry about the performance of 
various programs and their constitutent rese^u'ch 
projects. While data coilection by NSF and gropns 
outside the Federal Government has been instruc- 
tive, it could be greatly enhanced. Much information 
could be collected on tlie Federal reseaich system 
that maps trends, at different levels of aggregation 
and units of analysis, for dif i'-ent users. However, 
the existence of data does r a ensure their utility. 



The highest priority in dati: crl'cction for research 
policymaking in the 1990s is comparable data from 
all of the agencies to help Congress maintain a 
weU-rounded view of federally supported research. 
The second piiority is data presented in forms that 
are instructive at various levels of decisionmaking. 
New uata and indicators, grounded in the tndition of 
the SEI volume^ and extramural research on re- 
search, are needed to monitor changes in the Federal 
research system.^^i Finally, OTA Pads that research 
evaluatioii techniques, surli ab bibliometrics and 
portfolio analysis, cannon replace hdgments by 
peers and decisionmakers, but can enrich them. 
Ongoing project evH>)jation could keep agencies 
alert to changes in research performance and aug- 
ment program manage* judgments about p^^rmers 
and projects. In short, such evaluation coula serve to 
improve overall program effectiveness. 

One of the functions of analysis is to raise 
questions about the information that decisionmakers 
have at their disposal, to assess its advantages and 
disadvantages, and to defme a richer menu of 
options.^^'' Improving the n^*casuremcnt process 
could help to qurntiiy existing opportunities and 
problems, and pinpoint previously uncovered ones, 
relevant decisionmaking at all levels of the 
A edwral Government. 

Toward Policy Implementation 

Siixe the post*3putnik era, both the U.vS. capacity 
to periorm resea ch and the demand for funds to 
sustain swien^'flc progress have grown. Federal 
investments have fostered the research system, 
managed through a pluralistic agency structure. This 
structure has supported the largest and most pre Juc- 



"'llKNatiotiaJ Scieixf Foundatirj routinely conducts '*u.sersurvcys." if Science Resources Studies (SRS) knows firomquestioniuire responses uow 
its various data reports are rscd- they influence research or education policies? are they a source for administrators or faculty-researchers? — then 
NSF should have a sense Q'!k \&* ice "consumption" aiid '^utilization" patterns. These would suggest which reports could be dropped, repriced, and 
modified. For an example of ^RS inventory of ^'mlramural pMblications." see National Science Foundation. Publications List: 19/7- J987, NSF 
87-312 (Washmgton. IX: Ju ;?). 

••*^OTA mtcrvicw with Office af Management and Budget sUff. Fib. 7. 1991. 

'-^^As several National Science Foundntion suff have indicated to OTA projC(.i staff (personal communicatioiw, Octobcr-Doceml: ^ 1 59(J)» the Srie?Ke 
Advisor draws Iwavlly on unpublislicd and newly published Science A Engineering Indicators (SEI) data in preparing nd presenting the 
Adminisiraiion's policy proposals at congressional *'posnjrc bearings' ' early in rJ / annual authorization process. Indc^. the piodi ction cycle of SEI 
IS geared to delivery of the volume as an Input to this budget process. 

'^'Quantitative data will not suffice. Information on the contexts in which researchis performed, and characterislicii of the perfomieri individually ar.d 
collectively, will provide clues lo how ll>c numbefs can be interpreted and perhaps acted on. For ejiample, see Daniel T. Layzell. '*Mosl Research on 
Higher EducaUon Is Slaie. Iirelcvf .u. and of Little Use to Policymakers." The Chronicle of Higher Education, v( 37. No. 8. Oct. 24. 1990, pp. Bl. 

B3. 

'22Tliis leads OTA lo sugg. that the research agencies, especially the National Science Foundation aivJ its policy progiams. remain in close louch 
with exterrul analysts of the Federal research syjieni Keeping abreusi of other new measurement techniques and findings related to people, funding, 
and rescarcli activities would be a modest but fruitful mvcsineni in extending mhouse capabiliues and refining knowledge of federally sp-'^tuored research 
perfonnance 



42 • Federally Funded Research: Decisions for a Decade 



Table 1-5— Doslred Data and Indicators on the Federal Research System 



Category 



Agency funding 
allocation method 



Redeardi expenditures 



flosearch work force 



Research pmcoss 



Outcome measures 



Indicators 



Primary users 



Description 



Method 



Congress Agencies 0MB OSTP 



Funding within and across fields and 
agendes 

Cross-agency information on proposal 
sutxnisslons and awards, research 
costs, and the size and distrllxitlon of 
the research work force supported 

Research expendit'tf^os in academia. 
Federal and industrial lat>oratorles, 
centers, and university/Industry col- 
laborations 

Agency allocations of costs within re- 
search project budgets, by field 

Mogaproject expenditures: their compo- 
nents, evolution over time, and con- 
struction and operating costs 

Size and how much is federally funded 
Size and composition of research groups 

Time commitments of researchers 
Patterns of communication among re- 
searchers 

EEquipfDent needs across fields (including 

the fate of old equiprDent) 
Requirements for new hires in research 

positions 

Citation impacts for Institutions and sets 

of institutions 
International collaborations in research 

areas 

Research-technology intbrface. e.g., uni- 
versity/industry collaboration 

New productkMi functions and quantita- 
tive project selection measures 

Comparison between earrrarked and 
peer-reviewed project outcomes 

Evaluatlonof research projects/programs 

Proposal success rate. Pi success rate, 
proposal pressure rates, flexibilltyand 
continuity of support rates, project 
award and duration rate, active re- 
search community and production 
unit indices 



Agency data col- 
lection (and 
FCCSET) 



Agency data 
collection 



Lead agency 
survey 

Lead agency 
survey; onsite 
studies 



Bibilornetrics; 
surveys of 
industry and 
academia 



Agency analysis 



Kl^y- f^CCSPuredoral Coordinallng Council on Sdenc«. Engineering, and Tochnotofly; OMD»Offic© of Management and Budget. OSTP.Offioe of Sdence 

and Technology Policy; PUprinapal investigalor. 
SOUHCE. Olticu ot Tecrinology Asaessmenl 1991 . 



live research capability in the world. For many 
decades, scientific research ha.s contnbuted in im- 
portant ways to the cuhural, technological, and 
economic base of the Nation. 

In the I99()s, chan^'ing funding patlciiis and 
vaiious pressures from both outside and within tlie 
scientific community will test the Federal research 



system. In such an environment, the prospects of 
fashioning a system that is responsive lo national 
needs through selective^ yet generous research 
funding will demand well-informed, coherent poli- 
cies. 

The system will face many challenges, but four 
arc clear: Firsts new methods of setting priorities and 



'^^Ns Brooks has observed **Tlw research cmcrpn-ic is more like an organism than like a collection of objccLs. The removal of one part may degrade 
th<i fuiKtioningof ihc whole organism and iwl jus! Wic parUculor function oxiciwihly tervcd by ihc pan removed '* Harvey Brooks. "Model* for Science 
Planning/' ruNic Adminisfranon Review, vol 31. May/Juiic 1 97 K p. 364 Policies must respond lo. and in some ways, aniicipale. Ihc consequences 
of funding decisions on Uie rcsciuch syjiicm. Indeed, itiis report lias ' ed lo warn about cxtrapolaling the past lo manage the future of the system. 
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increased use of existing methods are required at all 
levels of de'cisionmaking. Second, Federal expendi- 
tures for individual components of research projects 
have increased faster than inflation. Understanding 
and coping with these increases is imperative in 
research decisionmaking. Third, the development of 
human resources for the science and engineering 
work force must occur through Federal incentives 
and institutional programs that act on the educa- 
tional pipeline (K-12 through graduate study). Fi- 
nally, gaps and uncertainties in the data used to 
describe the Federal research system must be 
reduced, and be replaced by more routine provision 
of policy-relevant information, 

OTA flnds that Con};rCvSS, the executive 
branch, and research performers must converge 
on these issues. Potential congressional actions 
fall into three categories. Congress can: 1) retain 
primary responsibility for decisions and initiat* 
ing actions; 2) place some of the responsibility for 
coordination and decisions on the executive 
branch; and 3) encourage research performers 
(especially universities, as well as Federal and 
industrial laboratories) to address components of 
these issues. (For a summary of possible actions, see 
table 1-6.) 

At the congressional level, hearings, legislation, 
and oversight should first address crosscutting and 
within-agency priority setting at the national leveL 
OTA suggests that one or more committees of 
Congress routinely (preferably biennially) hold 
hearings that require the reseiu-ch agencies, OSTP, 
and OMB to present coordinated budget plans with 
analyses that cut across scientific disciplines and 
research areas. Coordination among relevant com- 
mittees of Congress would make this most produc- 
tive. These hearings could also focus on crosscutting 
criteria for research decisionmaking within an J 
across agencies. Emphasis must be placed on criteria 
to expand the future capabilities of the research 
system, such as strengthening education and human 
resources. A second set of congressional actions 
could explore cost-accountability efforts at the 
research agencies and throughout the research sys- 
tem. A final set of hearings ought to examine tlie 
state of data on the research system and improve- 
ments to infonn congicssional decisiomnaking.'^ 



Table 1-6— Summary of Possible Congressional, 
Executive Branchi and Research Perfornfwr Actions 



Congresslorwl hearings, • Set priorities across and within 
t^lslatly0 0ftort$, agenoles, arxi develop approprl- 
and oyarslght to: ate aeency missions. 

t Evaluate the total portfolio to see 
If It full Ills national research goals, 
human resources needs, scien- 
tific Infrastructure develOi;>ment, 
and t>alance. 

• Initiate greater cost-accounta- 
bility throughout the Federal re- 
search system. 

t ExpaiKl programs that fortify the 
educational pipeline for science 
and engineering, and monitor the 
comkiinod oontrttxitlons of 
agency programs to achieve edu- 
cation and human resouroes 
goals. 

• Augment data and analysis on the 
Federal research system for oon- 
gresslonal decisionmaking. 

Executive branch • Enhance cross-agency priority 

actions to: setting In the Federal budget and 

increase research agency flexibil- 
ity to address new priorities. 

• Institute better oost-acoount- 
ability and cost-oontalnment 
measures by agencies and re- 
search perfornf)ers. 

• Expand agency programs to pro- 
mote participation in the educa> 
tlonal pipeline for sdenoe and 
engineering, and require agen- 
cies to report progress toward 
these goals. 

• Monitor and analyze policy- 
relevant trends on the research 
system, especially as related to 
the changing organization and 
productivity of research groups 
and Institutions. 



Research performer 
actions to: 



• Contain and account for research 
expenditures. 

• Revise education and research 
policies as they affect: a) recruit- 
ment and retention In the educa- 
tional pipeline for sdenoe and 
engineering, and b) faculty pro 
motion, tenure, and laboratory 
practices. 



SOURCE: Office of T«chnolooy AsMssrn«nt, 1991 . 



Hearings could be followed with congressional 
oversight — on agency progress toward their re- 
search missions, implementing the criteria chosen 
by Congress to enhance research decisionmaking, 



\% « role for the congrcsxioruiJ suppofi ii^icnciM. as well a.H other sources of cxpcn advice. For other proposal, sec Carnegie Commission on 
ScicDce, Techiioiogy. and Ciovcrnrncm. Saence, Ttchnolof^y, and Conf^ras Expert Advice and the Deaston/nakinx Process (New Ycfk, NY; Ftbiuary 
1991). 
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instituting greater cost-accountability, and provid- 
ing useful data and analysis on an ongoing basis to 
Congress. 

Some of these hearings and oversight efforts 
already take place in committees of Congress. While 
they have been very useful, OTA finds that to effect 
change in the research system, congressional action 
must be comprehensive and sustained. Posture 
hearings with the Science Advisor and agency 
directors will not suffice. 

In its role as the prime sponsor of Federal research, 
the executive branch (especially OSTP, 0MB, and 
the research agencies) could provide more flexibiHty 
in response to changing research priorities. For 
instance, the executive branch could systematically 
initiate tradeoffs among agency research programs 
including, with the cooperation of Congress, the 
termination of programs. This would help to create 
more coordinated research policies. Similarly, the 
research agencies could institute greater cost- 
accountability measures, and include costs as ex- 
plicit factors in decisionmaking at the p/oject level. 
This would provide a more reahstic assessment of 
future capabilities with respect to projected funding 
levels. On human resources issues, the executive 
branch could implement or expand agency programs 
and reporting requirements to: 1 ) encourage recruit- 
ment and retention of women, U.S. minorities, and 
other underparticipating groups in the educational 
pipeline for science and engineering; and 2) monitor 
the changing sUiicture of research performance, 
especially forms of research organization, and de- 
vise funding allocation methods that accommodate 
both the needs of the PI and research teams. Finally, 
each of the research agencies (with NSF as the lead 
agency) could conduct routine data collection and 
analysis on policy-relevant aspects of their program- 
matic contributions to the research system. 

Not all problems in tlie research system, however, 
can be addressed in Congress or by the executive 
branch. Universities and laboratories (both Federal 
and industrial) are key components of the system, 
and many policies are dictated by the practices 
within these institutions. Containing research ex- 
penditures and expanding the educational pipeline 
through institutional programs and requirements are 
exiunples of policy areas in which research perform- 
ers must fulfill their role in tlie social contract 
implied by the Federal patronage of research. The 
Federal Government can only encourage univcrsi- 
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Communication among scientists and engineers Is an 
essential part of the research process. 



ties and laboratories to follow new paths; few direct 
Federal incentives are available to initiate change. 
Greater delineation of government and research 
performer responsibilities would help to sanction 
congressional and executive branch action on prob- 
lems in the research system. 

In addition to specifying at which level (congres- 
sional, executive branch, or research performer) 
issues could be appropriately addressed, responses 
to the four challenges outlined above must also 
recognize many inherent tensions in the research 
system. They include the merits of more centralized 
decisionmaking juxtaposed against the advantages 
(and realities) of a decentralized Federal research 
system. Otlier tensions arise between the funding of 
mainstream individual investigator programs and 
set-aside or more specialized programs (see again 
table 1-1). Inevitably, policies that relieve some 
tensions will engender others. 

In summary, dccisiomnaking in the Federal re- 
search system concerns many laudable goals, and 
the options are clearly competing * 'goods.'* Thus, 
the Federal Government must make tough choices, 
even beyond issues of merit and constricted budgets, 
in guiding the research system. A quarter-century 
ago» a chapter on Science ana the Federal Govern- 
ment'' concluded witli these words: 
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As never before in history, the status of science patron and has fashioned a host of institutions to 

and technology has become an impottant hallmait of administer vastly increased commitments to scien- 

a nation's greatness; and the United States clearly tific and technological excellence.^^ 

has perceived and acted upon this fact. In the process, 

the Federal Government has displaced the univer- Sustaining and managing this system is the chal- 

sity, industry, and the private foundation as chief lenge of the decade ahead. 



i^Cilcd in Ralph Sanders ana Pit:*! R. hiowMed&XSafncfandTevhnolo^y: Vitai National Assets (V^&slMngxofu DC: Industrial Collcflcof the Amod 
force*. 1966), p. 86. 
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CHAPTER 2 

The Value of Science and the Changing Research Economy 



This is a golden age of scientific discovery with great potential to improve our 
performance as a Nation. This is the rationale we use in our requests for increased 
funding. But even a country as rich as the United States cannot write a blank check for 
science. We need to discipline ourselves in how we request support and in how much we 
ask for. Otherwise we will lose our credibility, 

Frank Press ^ 



Introduction 

Research advances the world stock of scientific 
knowledge and the countries that finance its pursuit. 
The United States, in particular, has a history of 
strong support of research and belief in its inherent 
worth. Scientific discoveries have spurred techno- 
logical and other kinds of developments since the 
beginning of the industrial age, and thus have shaped 
much of Western culture. Cures to diseases have 
been found, better automobiles and space probes 
have been developed, the Earth and its environments 
more fully understood, and the foundations of 
atomic matter explored. . 

The importance of science to progress in most 
Western societies is indisputable. In the words of 
two economic historians: 



Science ... is pushing back the frontiers of 
knowledge at what seems an accelerating pace. 
Because knowledge creates economic resources and 
because knowledge generally grows at an exponen- 
tial rate, future advances in human welfare can be at 
least as striking as those of the past two hundred 
years. ^ 

In the United States, scientific and engineering 
research has a significant impact on the products and 
processes that fuel U.S. economic growth and 
productivity.^ There is also ample recognition of the 
significant role played by the Federal Government In 
legitimiiing and financing research as a public 
good.** (This is epitomized by the case of supercon- 
ductivity, see box 2-A.) Such findings are reassuring 
that, in the words of science policy statesman 



'"NAS Annuai Meeting: Kudos From George Busli, Challenges From Friuik Press/' NewsH^port of the National Research Council, vol. 40, June 
1990. p. 8. 

Nathan Rosenberg and L.E. Birdzrll. Jr.. "Science, Tccbnology and the Western Miracle." Scientific American, vol. 263, No. 5. November 1990. 
p. 54. 

^Reporting iJie results of a new empirical investigation, economist Edwin Mansfield finds: . . that about onfr-lenlh of the new products and 
processes commcrciall/ed during 1975-85 in . . . [seven] industries could not hive been developed (without substuniit] delay) without recent academic 
research. The average time lag between the conclusion of the relevant academic research and the first commercial introduction of the innovations based 

on this research was about seven years A very tentative estimate of the social rate of return from academic research during 1975-78 is 28 percent. 

a figure tJiat is based on crude (but seemingly conservative) calculations and that is presented only for exploratory and discussion purposes. It is important 
thai this figure be treated with proper caution — Our results . . . indicate that, without recent academic research, there would have been a substantial 
reduction in social benefits," See Edwin Mansfield. "The Social Rale of Reiu a From Academic Research.** /J^j^arcA Policy, forthcoming 1991 . 

Another analysis, using different measures, supplements Mansfield's finding. While knowledge is found to be a nujor contributor to productivity 
growth, tlicre is roughly a 20- year lag between the appearance of research in the academic community and its effect on productivity as measured by 
industry-absorbed knowledge. See James D. Adams. "Fundamental Stocks of Knowledge and Productivity Grov/th," Journal of Political Economy, 
vol. 98, No. 4. 1 990. pp. 673-702. Of course, during the 20-ycAr gestation period, much applied research and development must occur before the effects 
on industrial productivity are realized. Economist find Mansfidd's empirical approach the most direct evidence of economic returns to date. Summary 
of reactions at American Economic Association and National Science FouTKlalion seminars in 1989 and 1990 provided by Leonard Lcdcrraan» personal 
communication. January 1991 . For a discussion of measurement techniques, see ch. 8. 

^Indeed, tlic U S. research system is designed so that returns on Federal mvcstment will accrxic to the private sector and other natioitt. The results 
of publicly funded research are for the most part openly disseminated witli little or no copyright protection or patent exclusivity. For how this situation 
is changing, sec U.S. Congress, Office of Ibchnology Assessment, Intellectual Property Rif^htx in an Age of Electronics and Informarion, OrA-Crr-302 
(Washington. DC U S Government Priming Cfficc. April 1986) Also see Congressional Budget Office. ^'Federal Investment in Intangible Assets; 
Research and Development." unpublislicd document. Februiu^ 1991. 
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Box 2-A— History of Superconductivity: Scientific Progress Then and Now 

Tlie history of superconductivity illustrates tlie episodic nature of progress in scientific research and the 
lunitations of predictions for scientific advancement in a specific research area. Due to resistance, normal 
conductors will lose energy in the fonn of light or heat when a current is pass'xl through them. While this is not 
a wholly undesirable effect (e.g., in heaters and light bulbs), in most electric applications, resistance wastes energy. 
Successfully harnessing the resistance-free currents of superconductors could be revolutionary: energy could be 
transmitted with perfect efficiency; electronic devices could be made faster and smaller; and the power of 
superconducting magnets (many of which arc much stronger than traditional electromagnets) could transform 
traditional transportation methods botli on land and ai sea.^ The first superconductor was discovered in 1911 by 
Kammerlingh Onncs. a Dutch scientist. Using liquid helium, Onnes cooled meicury to 4 degrees Kelvin (K) above 
absolute zero,^ at which point an electric current flowing through the mercurj' suddenly lost all resistance (for a 
chronology of subsequent progress, see figure 2A-1). 



The Science of Superconducting Materials 

Limitations on the physical properties required 
for a material to superconduct have hindered wide- 
spread applications. For every superconducting ma- 
terial there is a threshold for its physical properties 
(temperature, magnetic field level, and current density) 
above which it will not superconduct. By the 1950s, 
researchers had discovered many materials that would 
sujxjrconduct, but at temperatures no higher than about 
20 K. 

The 1950s brought two separate breakthroughs 
that moved superconductivity closer to applicability. 
First, researchers in the Soviet Union discovered a new 
class of superconductors that would remain supercon- 
ducting in high magnetic fields, and that could 
eventually be used in superconducting magnets. Sec- 
ond, in 1957. the American research team of Bardccn, 
Cooper, and Schreiffer received the Nobel prize and 
recognition for a theory explaining superconductivity. 

From the 1950s to the early 1980s, progress 
toward higher temperature superconductors was slow. 
Then, a surprising breakthrough occurred in late 1986 
that transformed superconductivity research and drew 
widespread public attention. In Zurich, the IBM 
reseajch team of Bedjiorz and Mueller discovered a 
new ceramic material that remained superconducting 
at temperatures as high as 35 K. A few months later in 
1987, a research team at the University of Houston 
developed a similar ceramic material that could 
superconduct at 92 K. Not only did these discoveries 
provide the long-awaited :ibility to use liquid nitrogen 
instead of helium as a coolant, the discoveries were 
made at such an incredible pace, cofisidering the 
history of superconductivity research, that the goal of 
room -temperature superconductivity (at roughly 300 
K) suddenly appciircd to be within reach. 



Figure 2A-1— Superconducting Critical Transition 
Temperature v. Year 
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SOURCE: U.S. Cofigraas. Offteo of Technology A$»fl6sm«nt. High- 
T0mp0ratur0 Superconductivity in Perspective, 
(Waihlngton. OC: U.S. Goverrtmont Printing Oftic«. April 1990) 
figur* 2-3. 



»l''or a more comprcrKMisivc dcscripiion of applicaiion.s for supcrcoiul activity acc U S. Congress. Offtcc of Ibchnology Asscssnicnl 
ifif(h Temperature Superconductivity in Perspective, OX\-R^ (Washington. DC: U.S. Govcnuncm Printing OfTicc. April 1990), 

2<)nc degree Kclvm (K) i% equal lo one degree Celsius (^Q. except that Kelvin is measured from absolute tcro (-in «C) Room 
icnjpcraturc (about 75 ^P. or 2.5 "C) .s about 300 K 
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The Federal Response 

The res{)onse lo these discoveries was enomious. 
'Oie popular press lauded high-temperature super- 
conductivity as **. . . the startling breakthrough that 
could change our world. Scientific meetings where 
superconductivity results were rumored to be released 
became standing-room-only events/* While the wm- 
perature barrier still frustrates researchers, work con- 
tinues in other areas that are key to useful applications 
of superconductivity, like current densities and rnag- 
nciic fields. Success has been attained in many areas, 
but much more research needs to be done. 

Fortunately, the Federal Government has main- 
tained its commitment: in 1987, President Reagan 
preseiUed an 1 1 -point agenda to increase superconduc- 
tivity research and development (R&D) in the United 
States, and in 1988, Congress enacted several laws 
I>ertainijig to sui>erconductiviiy R&D. mostly aimed at 
spurring commercial development of superconducting 
technologies, llie Federal superconductivity budget 
rose from $85 million in fiscal year 1987 to $228 
million in fiscal year 1990, wiih most of the increase 
going to high-temperature research.^ Funding is spread 
among several different agencies, primarily the De- 
partments of Defense (DOD). Energy, iind Conmierce, 
the National Science Foundation, and the National 
Aeronautics and Space Administration. Prograjns ai 
different Federal agencies have aided scientists in the 
exchange of research information.^ 

Congress has made several attempts to coordiriaic superc.Miducliviiy research. Piut of the 1988 Omnibus Trade 
and Competitiveness Act created the National Commission on Superconductivity (NCS). The Trade Act also 
mandated an increase iji staff for tlie National Critical Materials Council (NCMC). Finally, the Naiional 
Superconductivity iuid Competitiveness Act of 1988 called for cooperation among the Office of Science and 
Technology Policy (OSTP), NCMC, and NCS in order to produce a 5-year National Action Plan for 
Superconductivity to be accompanied by annual reports. The success of these initiatives has been limited. ITie 5 yciu- 
National Action Plan was published in December of 1989, but the fonnation of NCS was delayed. Although the 
plan itself acknowledged the need for l)etter Federal coordination, it lacked both the budget recommendations and 
the long-term pers})ective Congress had requested.^ In addition, OSTP's I^ederiil Coordijiating Council on Science, 
F:ngineering, iind Technology Committee on Su[>erconductivity repon of March 1989 did little more dian assemble 
agency superconductivity budget data and list programs in the agencies.^ 

Questions remain, such as whether IX)D funds too high a percentage of superconductivity research and 
whether the Federal laboratories are doing too much of the research relative to other [)erfonners. Progress in the 
development of high -temperature su[)erconductivity is likely to unfold slowly— wiili substantial assistance from the 
Federal Government. 



Photo credit: US. Dspvtm^nt of Energy 

A magnet is levitated by high-temperature 
superconducting materiais that are cooied in liquid 
nitrogen. Superconducting materials may eventually 
Itivitate much larger bodies, such as n«gnetically levitated 
trains. Superconductivity Is a research area that may yield 
many fruitful applications. 



^Michael I). Iirmonjck. *'Supt!ra)iuluL tors'" Time, May 1 1. 1987. p ty\. 

Aditinsik. "A Super Yciir in Scit-ncc." Vixwn.u fall 1987. p. 20. 
*'(Mfite of R-chnology Assessment, op cil . footnote 1. p t^. 

^Ilic Ames lalx)ratory disiributcs "High T^. Update.'" a widely read newsletter, the national laborntdncs have broadca-si nalioiuUly 
several hiijh-tenij)eratufc supercondiiciiviiy conferences, and the ncpartn\ent of Bncrgy has established a computer database (hat s hares rcsem h 
results with industry. ITic National Aeronautics and Spaec Adnnnisiration also maintains a Space Systems TccJinitaJ Advisory Committee, a 
group with reprcscnuitivos fnun industry, universities, and government organi/.ations 

A)ffKc of Technology Asse.ssnieni. op. cif.. liH)tnoie 1. p M 

«lbid.p 69 
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Harvey Brooks: ''A strong basic science is a 
necessary condition for a strong economy, a livable 
envii'onment, and a tolerable society.''^ 

Survey results indicate that since the mid- 1970s 
public confidence in the scientific community 
ranked second only to medicine and ahead of 1 1 
other social institutions, including education, the 
press, and Congress.^ Furthermore, the expectations 
of the American public about science and technol- 
ogy during the next 25 years include cures for cancer 
and AIDS, safe long-term storage or disposal of 
wastes from nuclear powerplants, establishment of 
a colony on the Moon, and development of geneti- 
cally engineered bacteria to destroy toxic chemicals. 
But among the same sample of aduhs, realism about 
the possible negative consequences of science and 
technology is clearly evident. More than two in five 
respondents conside/ed another Three Mile Island- 
type accident and the accidental release of a toxic 
chemical that results in numerous deaths of Ameri- 
cans **very likely.""^ Finally, when asked tlieir 
preference for problems that should receive more 
Federal funding, three of four Americans responded 
'^helping older people," ''improving education," 
and "reducing pollution," two of three noted 
"improving health," one in two favored "helping 
low income people " and one of three responded 
"scientific research" (which was well ahead of 
"exploring space" and "improving defense").^ For 
fiirther discussion of Federal funding in the "public 
interest," see box 2-B. 

Taken together, the investments and expectiitions 
of the Federal Government in research have contrib- 



uted to a shining history of scientific advance in the 
United States. Universities, Federal laboratories, 
and industrial research centers have discovered 
many new phenomena and d'^veloped theories and 
techniques for their continued exploration and use. 
In the 1990s, preserving quality in research, while 
understanding changes in the poUtical and economic 
environment in which it has grown, will require 
planning and adaptation by research sponsors and 
performers alike. 



Research Funding in the United States 

Focusing on research (not development), as OTA 
does in this report, reduces the scope, but not the 
complexity of the Federal research system.^ The 
Federal Government spent over $1 1 billion in fiscal 
year 1990 on basic research and over $10 billion on 
applied research. Research thus represents 1.8 per- 
cent of the total Federal budget (at $ 1 .2 trillion). This 
1.8 percent, or roughly $21 billion, is an abstraction 
referred to as the * 'Federal research budget. 

Funding for research in the United States is led by 
the Federal Government (47 percent of the national 
total). Industry is a close second at 42 percent; 
universities and colleges (the category that includes 
State and local govenmient funds) follow at 7 
percent; nonprofit institutions and others fund the 
remaining 4 percent. Industrial support of basic and 
applied research has grown dramatically over the 



^Harvey Brooks. "Can Scicwe Survive in ilic Modem A^cl'* Science, vol. 174. Oct. I, 1971. p, 29. Brooks goes on to caution that a strong basic 
isciciKe is not a sufficient condition. For a recent postscript, sec Harvey Brooks. "Can Science Survive in ibc Modem Age? A Revisit After Twenty 
Years.** National Forum, vol. 71. No. 4. fall 1990, pp. 31-33. 

^^The question asked was: "As far as Uie people running these insdtutions are concerned, would you say you have a great deal of confidence, only 
some confidence, or hardly any confidence at all in them?" Since 1973. (torn 37 to 45 percent of the respondents indicated "... a great deal of 
confidence.** See National Science Board. Science and Engineering Indicators— J 989. NSB 89-1 (Washington, DC: 1989). p. 172 and app. table 8-11. 

^espondenli in 1985 were asked; ^'Do you think it is very likely, possible but not too likely, or not at all likely that this result will occur in the next 
25 years?" National Science Board, Science and Engineering indicator f--J 987, NSB 87-1 (Washington, DC; 1987), p, 150 and app. table 8-10. 

'llie respondents were asked to tell, for each problem, "... if you think that the government is i pending too little money on it, about the right amount, 
or too much '* Sec National Science Board, op. cit., footnote 6, p. 174 and app. uble 8-13. A sample of British respondents were asked the same question 
in 1988. Improving lieaJth care and helping older people topped their list, while 47 percent (v. 34 pacent of the U.S. sample) expressed a desire for 
increased government funding of scientific research. 

empirical terms. "re,search" has changing referents in the report. Sometimes a measure rcfen to * 'academic*' or "university** research, other 
times to "basic** research. The reader is alerted to these diffaent performers or activities as OTA reviews them and the sources of information used to 
characterize scientific research. 

'^1jc research figures are curretit dollar estimates. Sec Albert H. Tfcich ei aJ . Congressional Action on Research and Development in the FY 199! 
Budget (Washington, DC: American Association for the /\<Jvancemcnt of Science, 1 990). Other figures are computed from various sources cited in table 
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Box 2-B — Public Interest in Science 



At a time when U.S. society has embarked on more technological adventures than ever before, Americans 
apparently understand less about science and technology than citizens in other western countries. But understanding 
alone is not the issue; rather, it is the complex relationship among public understanding, public confidence in science 
and technology, and the public interest. * From the turn of the century through World War II, American technology 
and science came into its own. New inventions for the benefit of consumers were talked about everywhere from the 
Sears and Montgomery Ward catalogs to popular magazines; stories about the new invention, the telephone, were 
plentiful; and even if not ever>one understood the new technology, they had confidence in it.^ 

Military technology, given its lasting impact on everyone's lives during wartime, seemed easier to fathom 
•*back then." Soldiers understood how a gun worked; stories abound about how American GI's were able to fix 
things on ihe spot, using whatever spare parts tJicy could lay their hands on. People thought tliey understood the 
technology that surrounded them and that it was essentially beneficial,^ 

With the development of the atomic bomb (necessarily shrouded in secrecy) came the end of innocence. Tlie 
shattering of Hiroshima and Nagasaki was accompanied, for many, by a shattering of faith in science and technology 
as forever benign and helpful. In ways that we have only now begun to understand, the image of destruction 
associated with the atom bomb has affected all technology, cenainly all technology associated with nuclear power 
and nuclear waste. With Ihree Mile Island, Bhopal, the Challenger accident, and Chernobyl, this image of 
destniction has become tJie paradigm, for many, of all science and technology.^ 

llie discover)' of restriction enzymes that slice strands of DNA into separate pieces, and that DNA pieces from 
different species will connect with each other, has given rise to the great hope of understanding and curing genetic 
diseases. Yet it also has raised fears of somehow disturbing the natural universe, changing things that ought not be 
tinkered with. To know more sometimes is to fear more: "unintende<l consequences" is today a familiar refrain; 
even good intentions have side effects. 

The very advance of biological and medical knowledge itself leads to fmstrations and contradictions, further 
undermining confidence in science. If we can perfomi the miracle of organ tnmsplants, why can we not cure muhipic 
sclerosis? If we can cure childhood leukemia, why not lung cancer? Science editor Dmiiel E. Koshland writes: 

But architects of change, we [.scientists] have occasionally oversold the product, implying that it will bring 
unmixeil good, not acknowledging that a scientific advance is a Pandora'.s box with detriments or abuses a.s well as 
Ixrnefiis. By confessing that we are not omniscient wc may lo.se some awe and admiration, but wc will gain in 
ruiderstanding and rapport.' 

What can the scientific community do? Despite some negative feeling about science, or some a.spects of it, tliere 
are indications that the public is more interested in it and more willing to make the effort to learn than they are given 
credit for. Although 20 percent of college graduates eam science and engineering degrees, many more enter college 
eager lo leiim .science.^' The television program "Nova/* which covers all a.spects of .science, is consistently among 
the more highly watched programs on public television. And 95 daily newspapers across the Nation liave weekly 



' llus \h}x is adapu-tl troni Alan H McOowan. prcsidi'iu, .Scicniisi.s' Instiliitc for Public Infarmalion. who wrulc il expressly for Ihi.s OTA 
fojMHt under ihe liik" "Puhlic Undcfsiaiiding nf .Science." For :in overview of the relalionship bclwcen public inicrcst. iindcrstaiuling. and 
t^onridejicc, sec Kcnncih Prewitl, '^llie F^jhlic and Science Policy. " Scirmr, Ttrhnolof^y, A Human Uilues, vol. 7. spring 1982. pp. .*i-l4. 

'one of Ihe best dcscnptuMLs of ihis phenomenon i.s lo Im: lound in iJaniel J. Boorslin, The Americans The Democratu Exvenem e (New 
York. NY Viiiiage Htmk.s. 1974) 

^ riicfc is a dillcrcnce Ix^tweon undersiainlin^ the scicnufic pr inciples behind an mvcnlion or technology and Iiaving a geneiul idc;i oi how 
(he patt.s ii\ together or wh.u set^ucnce uf cvenl.s fnust occur to make the technology work 

•*Scc D.u-yl a Chub\n, "Progress, Culture, and the Cleavage of .Science From Society." Sac nee, Technolo^\, and Sonal rro)*ress, .S.L 
< .nldnun (ed ) (Belhleheni. PA U»high University J^ess. 1^X9). pp 177-I9S. and ' Is Knowledge a Dangerous Ihiny '" Ihe f 'amomtu vol 
nx. ich \(K 1991, pp 71-22. 

^D.imel i. Koslil.md, "lo Sec Ourselvi s As Oiher.s .See 1 /s." .V( irncr, vol 247. Jan 5. 1 WO. p 9 a corifenl analysis of how popular 
i:MV,t/ines poiir;i>ed Ncieiive in ihe first half ot (he 2t)i]i tcntury. see M.iicd C UiPollL'tte. Muktn^ Snrni c Our Own Puhlu Inui^^ts of Sneni c 
hiU) /vss (Chicago. II. Cniversity ol (Incago Press. 19V()) 

''f S Ciingress OHkc ol "K\hin»log> Avse.ssiiicni. liUmenuus afuiSvi i^nda^s hdumtion/tft Stiem r arui Ln\itnrenni!, VMSl 1 ♦ 
4 1 . W.tshiiixJitin. I>C I S CKnenifiKin I'riiiiinv ( ;iii,.f. [)L\emlKM P'HS).(.h I 
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Box 2*B— Public Interest in Science— Continued 

science sections which, according to their editws, ait among the most highly regarded sections in the paper. This 
represents a growth from 66 such sections in 1986 and 19 in 19847 

The attitude in the scientific conununity has also duuged, Fifteen years ago, most scientists avoided the 
popular press. Now, many scientists and engineers relish being quoted.* Still, wofking to improve public 
understanding is not rewarded in numy ways within the scientific community; the time is taken from other pursuits, 
and therefoie can be costly to one's career.' 

What mechanisms would encourage more involvement by scientists and engineers in raising public interest 
in and understanding of science efforts? Congress might include required spending of a portion of research grants 
on public understanding efforts, designating a fraction of each agency * s budget for an office devoted to help grantees 
develoD public understanding efforts, and giving awards to scientists who have made substantial contributions to 
public understanding.^^ At a time when more and more of American life is rooted in scimce and technology, and 
when the Nati(Mi*s economic well-being depends as never before on its understanding and utilization, the Federal 
Government cannot be complacent about the public's interest and confidmce in science. 



'Newspaper Science Sections Sdll on(heRise/'5/P/icop^vol. 18,ipring 1990, p. 1. Alone icieoce policy tutennsn writes: *'Ihave 
come (0 believe . . . thta the wty tilings will work out for Aniericsn science is very much in the bands of communicaton— of science writen 
and repoiten. They are a breed of science watchers, and the last thing in science's interests is to patronize or condescend to them.** William D. 
Carey, * 'Scientists and Sandboxes: Regions of the Mind,** American Scitntisu vol. 76, March-April 1988, p. 144. Also see Maurice Goldsmith, 
The Science Critic (London, England: Rontledge A Kegan Paal, 1986). 

>In addition, as sociologist Dorothy Neiidn puu it: ' * Dependent mm on political choices than peer review, many scientisu in the 1980s 
became convinced that scholarly communicatloo was no looger sufficient to assure support for their costly enteq)rise, that national visibility 
through the mass media was strategicaUy essential. They greatly expanded effbrts to work the media, tryii^ to shape Uw images conveyed.** 
Doit)thy NeUdn, "Selling Science,** Physics Today, November 1990, p. 45. Also see the Q>eclAl issue in which this article appears, 
* 'Communicating Physics to the Public,** Physics Today, November 1990, pp. 23-36. 

^See Neal B. Miller, The Scientisfs Responsibility for Public Information (New Yotic, NY: Scientists' Institut ^^ for Public Information, 
Media Resource Service, 1990); and John P. DomieUy, **Researcbers Must Join Forces to Bolster Public Confidence and Pundiog Support,** 
The Scientist, vol. 4, No. 20, Oct. 15, 1990, p. 16. 

^^Precedents for such activities inchide a 1-percent set*asidc In the budgeU of the National Institutes of Health (NIH) for evaluation of 
NIH research, and the annual * 'Public Understanding of Science and Ibchnology** awards given to Kience Journalists by the American 
Association for the Advancement of Science and Westinghouse. 

1 ^Greater public understanding of science will not necessarily lead to greater Federal funding of research. As one commentator observed 
a generation ago: "Although there is no question that the public has demonstrated its williogneas to provide . . . support, I doubt whedier the 
intrinsic cultural value could be used to justify to the puUic or to politicians more than a small fraction of the present support for basic sctenc" 
in the United Sutes, or indeed in any oth^ m^or country of the world.** Harvey Brooks, *'Are Scientists Obsolete?** Science, vol. 186, Nov. 
8, 1974, p. 5C». 



last 20 years, es(XJcially in ihc curly ami micl- 
19S()s.*^ F-or basic research alone, (he F-ederal 
(fovenuneni funds 62 percent t)f the tolaL tolloweil 
by nulusiry (21 percent), universities and colleges 
(12 percent), and nt)n})ri)rn nistituiions atul others 
(5 percent).'-' 



While questions of relative futiding can be gauged 
with funding data (e.g., comparisons between Fexl- 
eral luui industrial support), it is not easy to compare 
ex[)enditures in one ycm" to those in miother. 
Hconi)mie change affects the '*value*' of a dollar 
over tune. Because sotne goods (foodstu lis, automo- 



" Div n.ition.tl i*tr«u! is IuiuU-jJ prim.uil) b> ihc \ nkr.U ( ioviTium-nt. imlusiry. .nuJ autiU'inK ui.sntmi(>ii^ In nulusiry ;uul ihc fV<K'rul 

( iovcniinciH t(»^i'rlicr iKLOunicd \of nearly ponini u! jijial Mjppoti. wjih ufiivi*rMtu*s iind ttilk-gcs cotunbuiinj! ^ pcrLoni. utui nlhcr nonprofir 
UKimainns fuMilinji I piTLrtii Industry t\ iIr- lar^cM MtJ^U- ^(uirn- n| H^[) funds. (Ucuidin^ 1)74 bilhon Lonjp.ncd die bciloral ( iuvcrtinunrs %M 
M\uu\. .md liu- pasi di i adr irpn-srrws a prnod id y.u'M yrowdj m uuhislnal R<VI) spi-rulirj^' N.itiDnal Slktki- J-nund.ilmn. S'afinnai l\uu'rn.\ aj HXl> 
f<t s,>i<rir\ /vvf). Nsr Uf> ( W.Lsfnn^Mnn. tK" M i> IWO). t.d>U' H 5 

i»f \\u'\c au>?r« >Mlr (lyDrcs ihc N.uu»n.d Siiimki" > t>iifu!.Uion rsinn.iU's fd Immi ''.i(>plKd/iU'M'li'pfnLn( hr oakili'vs Ms ik*N{>ilr M>nir fii//nK*ss tn 
laK*lin>: .irr llM»iijilil l«» fv K-h.d»U' Si c ihiil 
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This research Is part of an add raJn study In the Duk? Forest Project, NC. Research can take many forms, from space exploration 
to the study of microbes, and ainriost all are represented in the Federal research portfolio. 



biles, housing) change slowly over time, economists 
have developed so-called constant dollars or ••defla- 
tors" to use in comparing economic activity in two 
or more years. Constant dollars work less well for 
goods that change rapidly (e.g., computers, con- 
sumer electronics, and defense technologies), and 
not at all for products that, by definition, are 
dissimilar from one year to the next.^^ The use of ;my 
two deflators can also lead to very hirge differences, 
especially as the timefrmnc lengthens. Taking into 
account these difficulties in the use of deflators for 
comparing research funding over time, OTA has 
chosen to use the ''Gross National Product Implicit 
Price Deflator.'' This deflator reflects changes in 
total public ami Federal expenditures. Thus, OTA\s 
figures can bt* i^asily compared, as Congress rou- 
tinely does, with trends in other public cxpen.ses.^** 
(Box 2-C di.scusses different deflators and their u.se 
in interpreting trends in research funding.) 



Documenting Perspectives on the 
Future of Research 

The American public holds scientific reseiirch in 
high esteem, but does not see it as the Nation's top 
priority, ITiis contrasts with survey fmdings of the 
late 1980s and 1990 reflecting the perceptions of 
scientists and engineers. Biomedical researchers in 
acadernia and industry, recombinant DNA research- 
ers, young faculty re.seaichers in physics, and a 
cross-section of Sigma Xi (The Scientific Research 
Society) members all report difficulty in establish- 
ing or sustaining research programs and feiu* reduc- 
tions in Federal funding for individual-investigator 
resemch (which they see as a top funding priority). 
Perhaps the must forceful recent advocate of in- 
creased research funding is Nobel laureate physicist 



' Hn this corusiructiotu rescarth is a "product.** i c . hiis inciuiuiabic ouipuls. B\it the value r)f the oulpu! w no! dclem».incd by market prices. It would 
[mi more accurate perhaps to treat research as '-i *'pr(xcs.s/' i e . an activity or scrvjcc to the economy. 

'•♦nie executive brai\ch p f spccfivc is cofiiaitial in ihe Economic Report of the President (Washington. TX? l/.S Ciovcriimciit Printing Office, 1 990) 

•\See. respectively. Cialhip jkjIi results rcjwrted by the Pluurnaceu.ical Matiufacturers Ass(Kiaiion I-oundalion. Inc.. Lning Ground in Diomedical 
search The Shortaf^e of American Scientim (Washington. DC*. J-cbruxiry 1991); Isaac Rabiiio, '"Hie Impact of Activist l*rcssurcs on Recombinant 
UNA Research," Science, Technology, <& Human Valurs, vol 16. No. I, winter 1991, pp 70-87; Arruirican Miysical Society survey result.s reported in 
RonutnCzujko et al., **71ieir Most Productive Years Young Phystcs Fsiculty in 1990/' Physicx Today, rcbriiary 1991. pp 37-42, and PolilicaJ Economy 
Research Institute. '•Researcher Perspectives on the Federal Reseaah System.*' OTA contractor report. July 1990 (available througli the National 
Technical Information Service, see app. p). 
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Box 2-C— Calculating Constant Dollar . rends for Research 

While seeming a trivia', problem at first glance, calculating fiuiding trends for research in consiant dollars (i.e.. 
units that have the same spending power in each year) can be full of pitfalls. Different methods can lead lo quite 
different trends and. tiierefore. policy conclusions. For example, the constant dollar vaJi»':s calculated usng a 
method developed at the Department of Commerce (and used by the National Science Foundation) imply that 
research expenditures in the United States have giuwn by roughly 40 percent in tl.e peiiod 1969 to 1990. Similar 
calculations based on a method devc;ope<l by the Office of Management and Fudget (and used by the American 
Association for tlie Advancement of Science) imply tliat research expenditures have grown bv less t'lan 3 5 percent 
(see figure 2C-1).' ' ^ 

Figure 2C-i— Federal Research Spending In Constant Dolic^rs Using Two Different Def.'ators: 

Fiscal Years 1960-90 (In bli;ions ofi9{2 dollars) 



20; 



Deflator used for R&D by 0MB and AAAS i 



15 



10 



GNP rteflator used by NSF 



0 .... 

1960 19G5 1970 1976 1980 1985 1990 

" ^^''^Tr ^"""^ ^^velopmont; 0MB - Office of Manngerr<»nt and Budgel; AMS - American Assoclalion for the AdvcrKiement of Srtenco 
GNP - Gross Nalional Prod'/cl. NSF - National Science Foundnlion. 

SOURCES: Current dollar dala c ame from Nalional Sctence Foundation. F^doral Funds for Hofieafch nrxi DBvelopment, Detaiiod Histori a/ Tahhs 
nsciM Yoar^ 1955- 1,V0 (Washington. [X): 1990). table A; and Nalional Science FourxJntion. Selscfed Dnia on F»d^ral ^unds for 
Ros9<v<.h andOevolof>.^^^^^^ Y^ars 1989. 1990 and 1091 (Washington. L J. Docember 1990). taWo 1 . Deflator data came (rom Iho 
Office of Managomenl and Biidgel. Dix^get Analysis and Systems Division. unpublish<*H data, and National Science Board Sc^^nr a. -i 
Engir.^twng Indicators— 1989. NSB 89-1 (Washington. DC; 1989). app. table 4-1 

So how doe.s (*nc calculate a consian! dollar irenJ? The cbjtrci is lo tran.slaic dollars from one year lo the next. 
I t!., to tind the price of a rtiarket ba.sket of comrnoilities. 'Hie deflator is (he ratio of the purcfiasing {X)wer of a dolhu 
tor a particular year to that of a reference year. A change in the index means that purchasing power has changed 
with resjK'ct to the same market basket. This change can also Ik- expressed as "cs nstant dollars/^ such as 1982'' 
or ' * 1 988 ' ' dolhus. I'hese ratios can tlien adjust any dollar amount for a given year . > get a value in constant dollars. 

A set of ratios or indices for a series of years is called a * 'detlalor. * ' lo calculate a deflator, a coinpa'';s(irs u.ust 
be made between tiow much a specific thing co..is m the year m cjuestion and in the constant doHa. ynar llie 
differences between mclfuHis used to calculate constimt dollar trends dej^end on what gixxl or services :\re tracked 
to make up the dcfh'ior. l or instmice, increasing salaries are very different from increasing (or decieasiuc) prices 
of computers. 

C\)ngress is m(.s{ iiucrrsied m comparing research v-xpcndimrcs to other element- of the I "ederal budget 'I'hus. ' 
a deflator that reproscnts cxpendJtuies on prtxlucls and services thai are often f .uighl throughout the United i 



Unh.niMl uuxuny '.u ;U-t1.ii.'rs hnsicd h> ihc Aincru.M. AsstKi;m(»ti Uu fhc \.lv.ifKar)cnl .)l .Slk-iui-. s ()\A notes tint \Uc 

N.iiHm.jl Insliluu-s ol Hr.,1./, t.s.s ,is n,,u <lflKti..r. . ;dlnl it Min„u<lu .,1 KcmmiJ, .whI IVvHnpnu-m \>u,c Uakx. uhuh is .lisajsuul m[u 
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States--a constant doliar in the most general sense^is often the most useful for congressional policy analysis. 
Using the Omss National Product (ONP) Implicit Price Deflator developed by the Department of Corameice is 
usually acceptable^ since it employs a large market basket of goods to calculate its constant dollar ratios.^ Constant 
dollar trends foe research calculated with this deflator compare research expenditures to other expenditures 

tlux>ughout the economy. 

In other contexts* a deflator that specifies indices relating only to research (salaries, facilities, and 
iasinimentation) could be imtemble. In such a deflator, if 45 percent of total expenditures for research goes to 
salaies,^ 45 percent of the deflator would reflect the changes k tfirse salaries. When other components of the 
deflator are similarly adju$ted-**<;quipment, £scilities, and indirect and other costs— ^ new index is derived. Use of 
such an index to adjust total research expenditures would approximate how much scientists were spending in one 
year as if the prices and contents of the market basket of goods and services were unchanged (i.e., the effect of 
increasing salaries and cost of equipmem and other items would have been removed).^ Deflators are difficult to 
calculate for science and engineering research, because die items and mix of the market bask^ can change rapidly 
and they may be quite different in separate fields of inquiry* In addUikm, even a ^'correct** deflator of this type can 
be misleading because it only concents inputs and not the changing character of research outputs, i.e., one if not 
buying the same science and engineering ''product.'* 

Given the problems with nssearch-specific deflators and the advantage of a general ONP deflator to compare 
expenditures across the economy, all constant dollar figures and tables in this report were calculate witlt the ON? 
Implicit Price Detlator for 1982 dollani (unless noted otherwise). However, OTA does not make any specific policy 
assumptions based exclusively on constant dollar trends. 



Economic Report cftht Fresidenu Tixii'iXniued eo Cocigreu Febnuiy 1990 (WuU^Ktoo, DC: U.S. Oovenanent Pnntiiig Office. 1990). 
pp. 298^ table C-a. 

^Sce ch, 6 of ihlfl report. 

^No defhtof has been aeatod using this method. Brace Biker, Office rA MtDi^eaieac and Budget, pemxttl cotmnooicadon, Nov. 26. 
1 990. But see ■ pair of working pipon by John E. Jaokowiki« Jr., Nadonal Sckace Foondadoo. ' 'Do We Need a Price Index for Industrial Rft D7' ' 
a.d.; aiid ''Oinstnictkwof a McelndexforludustriaJRADli^^ 

aiKt Budget noncapital Federal expenditures deflator developed to nonnaliie all expenditures of die Federal Govenmeot that do not involve the 
specific procuiemeat of large, capiul itrm^obvunisly a much larger set of ezpcodituru than diose Involved in lesearch. As stated 1^ Brace 
Baker. Office of Mai»igerot&t snd Budget: *'This is nor an RftD deflator, it is a denator used to denate R&D." American Associaticci for the 
AdvBricemcot of Sc.^mce, op. cit.. footnote 1 . The problem with the use of this denatoris that even though it excludes uiany expendltorea uivelated 
to research, the expenditures that are reflected in the deflator are not guaranteed in any way to mimic research expfiises over dme. Coniwquently 
such a deflator may be just as wrong" as any other deflator to calculate research productivity. 



system and the place of U,vS, science in the world has 
remained strong. Other countries support reseiirch 
infrastructures at the forefront of nuuiy fields — 
which is expected in an iniernalionally competitive 
economy — but U,vS. science still ranks at or near the 
top in most fields. This is a lcsi;unenl to the strength 
iuui scale of federally funded rcseiu-chJ'* 

This system will face many challenges in the 
l^^yOs. mcluding living with light fiscal conditions. 
In the 19KOs, four categories of f*edera! spending 
consistently increased in consimit dolhu-s: defense, 
entiilemenls (vSocial vSecurily, Federal retirement, 



"■'nu-ro i^vvkU'IUc ih.it ihc I'fjtiai Sufrs ts a Uuxt^mcx m (he srrosws K'Iou>?ucnnf; o\\\cx iKilmns Sec Siis.m V. Co/vcascl .il (a!s ), IhcUixean h 
Swumtn Iranufwn. [MiKccihnys o) a SAU) Ach.ukcd Stucl> InstitiKo. W ('uKai, Kaly. (Kl I M, IW) (Ddrdrechl. Holldml Kluwcr. h^Xl) Hic 
i(iiCNlJ'»no| vihoihcr the I iiiinl St.ucs is "losing, ^roiincr' to oihor nalions very much dcpomls on whuh fioKh nr research :ir«v^ an.* of tonccrti, luul which 
indK .Uiusot M'scMfc hpnutut it\ M\ otWK hooscs lo nnhrutc r«>r csulciu c «i the t ontmry. scc( Jina Kolaia. "Who's No 1 in Science'* r<MitrH)(c.s Say U S " 
AVk y.-fi /Mnrv.K'h \:. l >'/|,|>p CI. (''>. an<l Nu Sltppa>!c Vet Seen in Sircn^rh of I' S Scunkc/ ' ,S'. /rn< /• WW/, /i. vol 2. No I Jamiary/t'ehniarv 

BEST m A"A!L:iCIE 



Leon Ixdeniian, who also relies on a survey of 
active researchers u\ major universities (see hux 

Such survevs can lake the [nilse of a population, 
lap()nig res[)i)iulcnis' [KMcepiions, experiences, iuid 
feelings. Other data, hovvever, must be assembled 
and analyzed to provide a more systematic, well- 
rounded characteri/.aiion of tlie state of atfairs - and 
general health- -<>1 the I Vderal research system. That 
is O I'A's objecMve ui this repi)rl. 

Although scieniisis may now feel engulfed t)y the 
stress of lescarch coin[)etuion, the Federal reseiirch 
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Box 2*D — An Interpretation of Researchers' Distress by Leon M. Ledcrman 

On January 7, 1991, Leon M. Ijcdcnnan, Nobel laureate physicist and President-Elect of the American 
Association for the Advancement of Science (AAAS), sounded **a cry of alarm** for academic science. He released 
a report to the AAAS membership expressing concern . . for the future of science in the United States f^nd for 
the profound cultural and economic benefits that science brings.**^ The following are excerpts from the report, 
which was based on an informal survey of natural sciences faculty in 50 U.S. universities, including the top 30 
institutions in Federal R&D funds received. The survey yielded letters from 250 scientists, The text below is an 
cxcerfjt from Ledcrman' s report and is followed by a postscript written by him expressly for this OTA report.^ 



. . . The responses paint a p>lcture of an acodennlc research community beset by flagging morale, diminishing 
expectatlor^, and c^trlctlng horlzor^. . . . 

(There were) three Incidents where we had to stand by wt^lo cornpetttof s from abroad moved forward on research based 
on our Ideas. . . . Ttie hlstofy of the past decode Is one of continued hofossment over money, lost opportunltios due to 
Inodequoto support, and a stifing of Imagination due to mor^y worries. If U.S. scientists must continue to stand by and watch 
as our best Ideas are carried forward by groups from abroad, our rtotlon cannot hope to escape a rq:^ld decline. 

"••Professor of Physics, 
Massachusetts Instttute of Technology 

. . . Academic science has not arrived at It^ present state through a corviclous decision by the Administration or 
Congress. No political leader has advocated stan/ing sdenco— Indeed, most feel that they support It strongly. 
Presidents Reagan and Bush have both promised to double the size of the National Science Foundation's budget 
within five years, and Congress, almost every year, appropriates more for the National Institutes of Health ttian the 
Administration requests. . . . 

However , recent growth has been Insufficient to comper^atc for the effects of the long drought that preceded 
It. Thus. In the view of those In ttie laboratories, there has been a grodual year-by-yeor erosion In the availability of 
funding and in the health of academic science over nearly two decodes. . . . 

I suspect that If \ were twenty years younger I woUd not choose an academic research career. Even now I find myself 
considering otr>er options. I'm tired of wrftlng "•TAcelienf proposals that oren't funded. 

—Professor of Chembtry, 
Duke Unlverstty 

. . . The (funding) problem Is compounded ... by a number of other factors that, token together, further restrict the 
results that con be obtained from eoch research dollar. One factor Is complexity— or v^^ot some observers hove 
colled "sophistication Inflation." As our understanding of nature Increoses, the questions we need to or^swer 
become more complex. There is a corresponding Increase in tt^e sophistication (and cost) of the equipment 
fieeded to do research, both for small, "table top" experiments and large facilities Such as telescopes and 
accelerators. . . . The cost of regulation Is a second foctor. In many fields, particularly in the life sciences, Increosed 
regulation absorbs significant funds and research time. ... A third factor Is Institutional overhead. According to the 
Notional Science Foundation, Indirect costs at universities (Including administration, maintenance of buildings, 
utilities, etc.) hove rist^n from 16 percent of the notional academic R&D budget in 1966 to about 28 percent In 
1 986. . . . (and this) meoris ttiot less money Is available to the laboratory scientist for the direct costs of reseorch. . . . 

The problem Is more serious than overage grant sl/e or proposal success rotes (at the Notion M Science 
Foundation and tt^e Notional Institutes or Health) , however. The letters reveal potentially Important changes in the 
way scientists as individuals pursue their croft. As a consequence of the Increasingly difflcutt search for furxjing, 
academic scientists ore less willing to take chances on high risk areas with potentially big payoffs. lr\stoad, they 
prefer to pioy it safe, sticking to research in which on end product is assured, or worse, working In fields that they 
believe are favored by funding agency officials. These scientists ore also Increasingly viewing their fellows as 
competitors, rattier than colleagues, leading to on Increasingly corrosive atmosphere. The rnanifestotloa*; of this 
attitude range from a reluctance to share new results with ottte» scientists to public bickering about relative priorities 
in funding different fields. 

Wo oro tondlng to do "jotor" projects, avoiding the high risk, bi^t high payoff projects. In the pres^int cHmate wo cctnnof 
(jfford to t*^cTve ext>e{lnnonts r^ot worV . Undergraduates, grcjduote jtudunts and post docs contlr\uully a^k at>out th© bonoflti 
of pufsUng an f^CQdonilc cofoor wtion funding 1$ so tight. 

—AsslJtnnt l-^ofossor of Biology. 
Camegle -Mellon U^llvor5l^/ 

KSvieme Thv End of the hmntxer'} a report troni ijcon M li;ilemmn, prcsidcnt-clcci. lo iJic Board of Dircciors ol ihc Amciicaii 
AvMiciatinn the Ailvjuicenicnl of Sc icnte (W:4shin>»ton. DC AtiRTUiin Association tor the AilvaiiccinciiC of Science. January 1 W| ). 
'^OTA eliHJs not ijcccssafily agrtv with the ornKlusion.s etther in the rcporl or the poslscnpt 
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♦K«f •!? hI'^T"^ '^^^T^^^'J^ reported that thoy are cutting back on thw number of students they are training, and 
that students now In tti© laboratories are opting out of research careers. . 

r,r^ ^J^^'!l!!'L''l!!"'''^T' °' Pf^uctfve groups Is serloijs, oven more dbtufblng Is t^x) fwgatlve Intkjence the present dltflcuttles 

0 aan°r Ser^lS^aX^JpH ^w^^^ ° Jt."*"^ ^'^ ^° ^"^ 'H?'^ °" '^^^ ^"t^ °bout twenty graduate students In 
reSa to a ^nini^fp^^^^ '[1^° academic sclerwe. One person raised his hand and he was 
«vZXtomr.^l!^I^^«^^ ° ^^"^ 9'°^P f'^a' tack of Interest In untvefsfty 
level positions Is their perception ti-wt the challenge of gaining funding Is now dominant over the, challenge of the science 

—Professor of Chembtry, 
Ufifvorstty of Illinois 

What would It take to relievo the acute problems In academic research and restore U.S. science to Its pre-1 968 
ana^r""^ ind .^tLT^'S^' ^'''I'^^fw^"" Independently of -practical" cor^stralnts dictated by current events, fvly 
analysis . Indicates that we should be spending at least twice os much as we were In 1968 (In constant dollars) 
nTn douh'ilnT^/^if '^'^ conditions of (this era), Indications from NSF, NIH and DOE tend to conflrlhe pre«u2 
or a doubling of the current level of funding for academic science, which amounts to about $ lO billion a year This 
huge sum could, I believe, be effectively deployed in Iwo or three flscol years. 

.H«ntfX°'^oH*'tSf '''^'''? ^r?' ' V""""^ 9'°^ °^ P^' year In the number of academic 

scientists and the complexity factor growth estimate of five percent per year Imply that a sustained flourlshlna of 

s'SSn'i inT^^"' '^VT 9^°^' °' ^9^^ "=> • • ■ Such an incr^lnt mar CSnd 

frnrt on of wnu h'^'V ''"w'"^' ^ °' ^® economy responds, academic research would remain on^. a tiny 
ractlor^ of total fedorol spending for many decades. Furthermore, even with such Increases. It would be a decade 
Jap^n oTSt Germany" rmearch expenditure proportional to GNP would equal the 1989 levels of 

February 1991 Postscript 

in his budget for FY 1'^, the President requested significant Increases for science, averaqlnq 5-10 oercent 
?hi.°i:th« ^^'^^ ^'m ^cle^^l^^^ ^ust stand In awe at the respec?S work has earned 

Tt^s .s he eighth year of rea Increases Initiated by the Administration and passed by Congress. Nevnrthelea The 
AAAS inquiry hos dramatically confirmed Indications of serious troubles at the laboratory bench. 

J.^Z^^'^ f r'"' """^'^"^ believing that. In spite of these Increases, the Nation Is seriously undorlnvostlna In 
research. One is the comparison with what our economic competitors are doing. Another Is the comparon cJ?u^ 
relatlveresearchcapabllltytoday with what it was In the late 1960s. « comparison or our 

<r clZ^'^'^^T.^^ ^'^®'""'V'ng when the work was done) as well as patents and o hard-to-quantlfy loss of 
cent ,c and techr^oloQlcal self-confidence point In the same direction The unprecedented strS Xn the 
scientific community described above Is another Indicator. wuwnrea srresb witnin the 

The crisis documented In the AAAS sun/ey must be viewed as part of a larger pattern of national decisions IVlv 

Cr.o£wo omolhl^nr ^T °' '^^"^^""^^ ^^'"^ ^'^^^^ ^ In thi 19°60s would have ^^^^^^^ 

fr ,^ S e near $30 40 billion for academic research. This Is what motivated the •unrealistic" proposal 

for o doubling of the budget with subsequent 8-10 percent annual Increases for at least a decade 

■,nr,^!!t^'V^1l!^ ""^""^ ^^"^"^^ ^"^^ concentrated on only one important element of a problem that must 
Tr^^jfyr^n ^ other components, such as non-mlHtary R&D In Industry and the national laboratories, and the overa 
t n T""^ K? '^^'"^""^ education are so intimately enhvined that they must be treoTed 

ogether On y very briefly mer^tloned In the report are the human resources devoted to what oconorS^t Robert 
Reich coils strategic brokers." those wt.o trar^slate R&D results Into economic products T^e record ofu s^ 
nve^tment in resc^arch and education, even given the Increases. Is one of decline relative to the GNP and rSaJ^v^ 
to other industr aiized societies. Whereas It Is surely true that sums allocated by the F3deral Government cou^^ 
^««?nr^n '^V ""f w ^Vr'^' (especially In education), the problem Is clearly undeunvitrn?ntTtre prfmar? 
asset Of a modern Ind'^trlal nation In the 21st century is Its brainpower; a skilled educated workforce 

1 he vision to recognize this as o salient feature of our times resides In many of our leaders No doiibt some such 
percepMon explains the favoring of science in torgh times. However, the resources mat a?erSy?SSdld a^o 
far greater, as ties been ••u-veaiistlcully" proposed In the AAAS report. Nevertheless If (T^e h^-n ca^^^^^ 
SSToSm^?, m '"t '^ ^"".T '""^ GNP or a $ 1 ,4 trillion Federal budget It bec5^^ c lea?tShe 

^ IT^ ' ° P' '^^"'c^ ^° ^^ear the human resources of the Nation-^r, educated 

capable wo k forco-os the key to a successiVil .society. If we choose wisely, and I let my im^aoS^ soar the 

inT^fmn n ^"^^^^^^ '"^ '^'Tf'^ ^^''^^^^^ ^««^c^ S50- 1 OObllllon ( n 1 W Wth ccJ^erSurate 

position of ft^e Nation as a d/namlc and resourceful see aty, a leading participant In the now alobal eronomv nf 
the 2 i sr century, if we fall to see this long term Issue. If we are dominated by our 'Mhird quarter " ? i?es f w^ hSt J 
because we t,ave lost faith in tt,e power of me human mind, our long term prospeSts^^Sl b^^ d?mal indeed 
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Medicare, and Medicaid), net interest on the Federal 
debt, and Federal spending on research. While the 
deficit continues at record levels, the Omnibus 
Budget Reconciliation Act of 1990 will temper 
Federal spending, including possible modifications 
and further priority setting in expenditures for 
research.^* 

In addition, the scientific community has grown in 
size since the 1960s, reflecting a rising research 
economy that supported the pursuit of many spectac- 
ular opportunities. However, as more knowledge is 
gained, expenditures for cutting-edge research have 
also increased. These factors have combined to 
magnify the burdens on research perfomiers and 
institutions, and on the Federal sponsors that fund 
them.^^ Many in the research system also wonder, as 
the uncertainty increases over enrollments by U»S. 
students in science, whether the next generation of 
scientists and engineers will sustain the research 
enterprise.2^ Tlie pressures mount on public policy 
to decide which opportunities are most urgent, 
which agency programs to favor, and the rationale 
for supporting a diversity of fields, sectors, and 
research personnel, In the words of Yale Medical 
School Dean Leon Rosenberg: 

llie scientific community is responsible in a 
major way for the paradoxes and dilemmas in which 
we find ourselves. . . . There are more opportunities 
than ever to ferret out \i\c secrets of human biology 
and apply those secrets to the reduction of human 
suffering. The dilemma is that we must obtain more 
funding for the support of this effort in order to 
capitalize on those opportunities and improve the 
morale of the scientific community, while at the 
same time acknowledging that we have been gener- 
ously supported for the past 40 years. 



This report explores the ''paradoxes and dilemmas** 
of supporting U.S. science in the 1990s, while this 
chapter introduces the history of the Federal research 
system and current challenges that demand Federal 
policy attention. 

Historical and Current Federal Roles 
in the Research System 

The Federal research system has many partici- 
pants. They include Congress, the Federal research 
agencies, the Office of Management and Budget 
(0MB), the Office of Science and Tfechnology 
Policy (OSTP), academic research institutions, Fed- 
eral and industrial laboratories, the National Acad- 
emy of Sciences complex, professional societies, 
think tanks, and others. Tbgether these compo- 
nents sponsor, perform, and guide the activity called 
**research." 

Recognition of the role of the Federal Govern- 
ment in the support of research grew during the early 
parts of the 20th century, especially before and 
immediately after World War II. During the 1930s 
and 1940s, the Departments of Defense (DOD) and 
Agriculture (USDA), the Public Health Service 
(largely through the National Institutes of Health, 
NIH), and the Atomic Energy Commission (then, the 
Energy Research and Development Administration, 
and now the Department of Energy, DOE) collec- 
tively funded a diverse Federal research portfolio.^^ 
In the 19SOs, the National Aeronautics and Space 
Administtation (NASA) began to sponsor space 
exploration projects, and in the 1960s, it launched a 
celebrated and successful effort to safely land 
humans on the Moon and to gather data on the solar 



'Outlays by Category,** Government Executive, vol. 22, September 1990. p. 44. 

^''Sce Jeffrey Mervis. ' *Scicncc Budget: A Zero-Surn Gumc. ' * The Scientist, vol. 4. No. 24. Dec. 1 0, 1 990, pp. 1 , 6; and David C. Morrisoo. "Finching 
tl\c Research Dudgcu'* NationalJournai, vol. 22, No. 49, Dec. 8. 1990. p. 2996. 

•''Set* William D. Carey. *'R&D in the Federal Budget: 1976-1990." and Rodney W. Nichols. "Mac West at Olympus: Five Puzzles for R&D," both 
in Science and Technology and the Chanainfi World Order, colloquium proceedings. Apr. 12-1 3. 1990. S.D. Saucr (cd.) (Washington, DC: American 
A.HSociiition for the Advancement of Science, 1990), pp. 43-51, 53-69. 

^llic gup between current rhetoric and current problems in science education a.s they relate to the Nation's research capability is examined in Iris 
Rotberg. **I Never Promised Yon First Place.'* Phi Delta Kappan, vol. 72, DeccmSer 1990, pp. 296-303. 

^•Quoted m Dick Tlwrnpson, "The Growing Cnsis in Medical Science." T/m*?. Dec. 17, 1990. p. 21. 

^Because univcniilies perform tlic preponderance of ba.sic and applied research and train most of the research work force, and because much of the 
data on research performance lias been collected on acade/nia, this report often focuses on academic research perfomiers. However, when relevant, and 
especially wlicrc data are available, other performers arc discussed. 

^\Scc Margaret W. RossUer, ' *Scicnce and Public Policy Since World War II. * * Historical Writing! on American Science. Perspectives and Prospects, 
SO KoWslcdl and M.W. Rossitcr (cds.) (Baliiniorc. MD: Johns Hopkins University Press, 1986). pp. 273-294. and iulius H. Comroe, Jr., 
RetroSpectrs^Scope. Insif^hts Into Medical Discovery (Menlo Park, CA. Von Gchr Press, 1977). 



6a 



Chapter 2— The V&/ue of Science and the Changing Research Economy • 61 



system. Federal reseai'ch was supported and selected 
in partnership with the scientific commumty and 
with little constraint to adhere to formal agency 
missions.^ 

For many years, the core of the national effort in 
science was increasingly understood to reside in and 
be expressed through the National Science Founda- 
tion (NSF).^ A 1965 National Academv of Sciences 
report, Basic Research and National Goals, went so 
far as to state that: 

... the National Science Foundation is viewed 
. , , as being responsible for . . , ' intrinsic basic 
science/ * the motives for which are relatively remote 
from politically defined missions. Since this is a 
S(xial overhead whose connection with specific 
applied objectives of the society is distant and 
undefined, it would seem . . . that allocation of 
resources to this activity would be even more 
difficult than the allocation to mission-related re- 
search, 

Since NSF prijiiarily funded rese{uch in universities, 
science policy was generally equated with the 
provision of lesources for research, principally 
through (he university-based research system. 



Although DOD, NASA, DOE, and USDA had 
significant basic and applied research budgets in the 
1960s and 1970s, and NIH funding soared with the 
War on Cancer in the early 1 970s, it was not until the 
1980s that infusions in defense research and devel- 
opment (R&D) and the debates over the importance 
of federally sponsored applied research once again 
highlighted the pluralistic Federal role.^'' **The 
fragmented, mission*oriented structure that emerged 
after World War II went a long way toward realizing 
\^evar Bush's vision of a Federal system for the 
support of science and engineering. In large meas- 
ure, it was responsible for the emergence of the great 
American research universities and the 'golden age' 
of science. "^^ Today, research is understood to be an 
activity pursued in many agencies of the Federal 
Government and sectors of the U.S. economy .^^ 

The wisdom of the compact between science and 
the Federal Government has been demonstrated 
repeatedly in the last half of the 20th century. As 
more and more has been explicitly demanded of 
scientific and technological institutions in U.S. 



^Scc U.S. Congress. House CornmiUcc on Science. Space, md Tbchnology, 'I^k Force on Science Policy, A History ofScitncf Policy in the United 
Statex. I94(hnh5. 99lhCong. (Washington. I)C: U.S. Govemineiil Printing Office. 1986), especially pp. 15-40; alw icc Alan T. Waterman, **Ba.sic 
Research in the United States,** Symposium on Basic Research, Duel Wolfle (ed.) (Washington, DC: American Association for the Advancement of 
Science, 1959). pp. 17.40. The celebrated Mansfield am^^ndmenl. passed as pari of tJie fiscal year 1970 Military Authorization Act (Public Law 91-121). 
prohlbiled military funding of research that lacked a direct or apparent relationship to a specific military function. Through subsequent modification, 
the Mansfield amendment moved the Department of Defense toward the support of more short-term applied research In universities. For a discussion 
see Cfenevieve J. Knczo, * 'Defense Basic Research Priorities: Funding and Policy Issues.' * CRS Report for Conf^ress (Washington, DC: Congressional 
Research Service. Oct. 24. 1990), pp. 5-9. 

^ While the Bush Report and the Stcelnuui Report (introduced tn ch. 1) were both effusive in their praise of the social benefits emanating from scientific 
advaikce and the underlying rationale for the Federal support of science, each took a different approach to the administration of a national science 
foundation. OTA points out that "... tlie Steclman report regarded science as a special interest. Although large-scale government support for science 
was i new phenomenon, science was not considered to be suffici':>tMy dlff^ent from other p* >y ar^tas to warrant any special political relationships/' 
Buf ,\ supporters were * V . . convinced that science was disdnct fri*^' 'sSer types of government programs, that it must be free fiom political control, and 
u...t,tobesuccessful. scientists sbouldbeabletodirect their ownafi.'.^' — ScientisU, . . . through advisory groups ana a system of review by scientific 
peers, would decide how research should be conducted and would influu^ce the research agent's.* * Sec U.S. Congress, Office of Tbchnology Assessment. 
The Regulatory Environment for Science, OTA'TM-SET-34 (Springfield, VA: National Ifcchnkal Information Service, February 1986), pp. 15-16. 

^^Oeorge B. Kisliakowsky, *\Summary,'* in Naiionsd A^^ademy of Sciences, Committee on Science aiHl Public Policy. Boj^c Research and National 
Goals, A Report to ihe Committee on Science arxl Asuonauiics, U.S. House of Representatives (Washington, DC: March 1965). p. 1 1. This collection 
of ciisays evolved, m the words of Committee Chairman Oeorge P. Miller, into . . the production of a comprehensive study designed to throw into 
bold relief some of the more serious phases of policy which Govenunent must consider in iu decisions to support or otherwise foster research in 
America. ** (p. V). 

2'FiMn the researcher's perspective, multiple sources of FedenU support provide funding fiexibility. i.e., choice among agencies Prom a Fedeml 
perspective, flexibility allows choice among alternative research initiative* and peiformers. New programs can be started or old ones rcfocused. 

2* Joseph 0. Moronc. Federal RAD Structure: T)vc Need for Chan'je,** The Bridj^e, vol. 19. fall 1989, pp. 3- 1 3. For a diKussion of the '•university 
* research economy,** see Roger L. Oeiger, *"llie Anwrican University and Research.** in Govemment-University-lndustry Research Roundtable, The 

Academic Research Enterprise Within the Industrtalized Nations: Comparative Perspectives, report of a symposium (Washington, DC: Nalicaal 
Academy Press. March 1990), pp. 15-35. 

^rhe importance of nonprofit foundations and die private sector in suppotting. defining, and utili7ing basic research is also indisputable (though the 
extent of their participation differs greatly by field, industry, aiul measures of contribution). See National Science Foundation, op. cit., footnote 1 1 . 
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society, the social contract has changed. A new 
relationship may be evolving, but the trusteeship 
remains intact. Tbday, with the expectation of 
sustained Federal support of science, concern has 
shifted to ' 'how much growth" and • 'how to manage 
expansion.'' With acute and widespread awareness 
of the dependency of research institutions on Federal 
support, money has become the lightning rod of 
debates over science and other institutional do- 
mains. While this is apparent to most decision- 
makers, equally Inr^portant but less visible is the 
issue of the organization for making policy choices, 
i.e., how to distribute whatever monies are allocated 
for research. 

Differing conceptions of urgency, time-scale, and 
level of investment feed tensions within the r-v/ien- 
tific community as Federal priorities change. In a 
dynamic, pluralistic system, discontinuities in fund- 
ing can be expected. Tlie Federal Government is 
accused of supporting faddish research on the one 
hand, and of sluggishness in responding to new 
research opportunities on the other. What is often 
seen as a choice between big science and little 
science, or between high-energy physics and molec- 
ular genetics, is often more apparent than real. 
Overall funding decisions are often shaped more by 
funding allocations between research ^uid other 
national objectives,^^ As symbolized in the debates 
over the Superconducting Super Collider and the 
Human Genome Project, there is a sense of congres- 
sional urgency, frusu-ation, and ambivalence over 
research goals. 

While representative democracy ultimately in- 
vests the power of decisionmaking in elected offi- 
cials of the Federal Government (who judge political 
and national needs), these decisions are tempered by 
expert advice. Such judgments have consequences 
for decisionmaking and accountability, especially at 
the research agencies.^^ More than the other 
branches of government. Congress — the representa- 



tive of the public interest — is at the nexus of the 
trusteeship for research. Congress plays an increas- 
ingly active role, both in determining the Federal 
research budget and in stewarding the Federal 
research system in directions that serve the public 
good (see chapter 3). 

Prospects tor the 1 990s 

Science and engineering are increasingly vital 
parts of the Nation's culture; research contributes in 
many ways to the technological and economic base. 
Since the post-Sputnik era, both the capacity to 
perform research and the demand for funds to sustain 
scientific progress have grown. As the research 
enterprise moves into the 1990s, the Federal re- 
search system will experience changing funding 
patterns and various pressures from both outside and 
within the scientific community. How, in the face of 
changing funds and goals, can Congress ensure that 
the research system satisfies national needs, while 
retaining the diversity, flexibility, and creativity that 
have characterized U.S. contributions to scientific 
knowledge and its payoffs? Four challenges are 
clear. 

First, new methods for setting priorities in re- 
search funding will be required. Looking across 
fields and at objectives that build on, but are not 
limited to, scientific merit is the responsibility of 
OSTP, 0MB, the research agencies, and the scien- 
tific community, as well as Congress. Each may 
weigh funding criteria differently, but each has a role 
in preparing the enterprise for tomorrow's research 
opportunities as well as today's. 

Concern over the amount and distribution of 
Federal research funding is voiced increasingly 
throughout Congress. As one former member put it: 

At present we have no well-defined proccs.s 
... for systematically evaluating the balance of the 
overall Federal investment in research and develop- 



^or coinnicntory on Iww 40 yewi of Federal fundifig policy .Urayc^l from !bc letter, and perhaps even Ihc ipiril. of Vumcvw Buih'i vision of a 
centralized system, gee Deborah Shapley and Ruitum Roy. Lost at the Frontier (Philadelphia, PA: ISl Prcsf . 1985). Tbc House Committee's Science 
Policy •nwk Force concuned with this appraisal in 1986, observing that: '^Thc National Science Foundation, originally conceived as a ceoual 
coordinating body, w^s left with a restricted juiisdiclion over unclassified, basic research." Hoiise Conunittee on Science and Tbclmology. op. cil., 
footiK)le 24. As Morone, op. cit.. footoote 28. p. 4, puts it: "In effect. Bush called for a Dcpartmeni 'if Science, which would fund research as well as 
education, natural sciences as well as life sciences, and mission-oriented research as well as general, or 'pu/c.' science." 

**Kcnncth Prewilt. '"Tlic Public and Science ?o\kyr Science, Technology. & Human \itlues. vol. 7, No. 39. spring 1982. pp. 5-14. 

^^For a discussion, see Gcnevie\e J. Knezo and Richard B. Rowbcrg. "Big and Utile Science." CRS Review, Fcbmary 1988, pp. (^8; and * 'Money 
for tlic Boffins." The Economist, vol. 318. Feb. 16, 1991. pp. 15-16. 

^^ITirecOTAconuactorrcporw. featured Uter in this leport. provide data on ilje rhetoric of accountability used by various participants in :he Federal 
wscarch syston. But sec Office of 'Ikchnology As.vjssnicnt. op cit . footnote 25. On the role of tlw media in piorooting accountability, sec Marcel C. 
Uf'ollclte. ^'Scientists and the Media: In Search of a Hcalllucr Symbiosis." The Scientist, vol. 4, No. 14, luly 9. 1990. pp. 13- 15. 
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ment and in the variety of fvMs thai we try to serve, 
llie R&D budgets of Uie different Federal agencies 
are evaluated separately and largely independently^ 
both within the executive branch and certainly here 

in the House and Senate Of particular interest 

are the criteria for evaluating competing research 
development projects ' ^ different fields and the 
organizational arrangements for helping us to do a 
betvci job of allocating scarce resources.^** 

Since the support of science and engineering 
research is vital for the future of the United States, 
the Federal Government attempts to maintain a 
strong **science base/' i.e.. research across a wide 
range of science and engineering fields. To tlie 
extent that specific iu-eas. problems, and projects 
may be singled out for enhanced funding, debate 
within the scientific community centers on the 
adverse impacts of funding large new initiatives, or 
•'megaprojects/* on the science base. The criteria 
and information to inform priority setting are thus 
paramount issues, as decisions must be made 
between competing goals. 

A second challenge is that, because demands for 
research funds are likely to continue to outpace 
funding in most parts of the reseai'ch budget, 
strategies for coping — devised by sponsors and 
performers alike — will be needed. Congress is 
especially concerned about the question of costs, 
because the Federal Government supports resciu^ch 
expenditures (e.g.. salaries, indirect costs, equip- 
ment, and facilities) that have increased over the 
general rate of inflation. In addition, more research- 
ers are performing federally funded research iuid, in 
the aggregate, are spending more across-the-boiU"d 
on their research projects.^' 




Photo credit: U,$. D^pmiwnt of Enrgy 



This Is a cross section of cable destined for the 
Superconducting Super Collider. Capital expenditures, 
especially for equipment, are an Integral part of most 
megaprojects. 

Recently, the Federal Government has expcn- 
mented with ways to cope with the rising demands 
of research, i.e., the expectations that spending will 
increase in the performance of research. First, 
Congress imposed salary caps on Nlli- and NSF- 
funded research grants. In fiscal year 1991, legisla- 
tion relaxed these constrictions. Second, Congress 
and USDA recently placed a ceiling on the propor- 
tion of indirect costs allowable on research grants. 
Tliis experiment has yet to be fully implemented, but 
it is expected that universities will attempt to recover 



^Doug Walgrcii. Chairman of ihc House Subcommittee on Science, Research, and Ifcchnology. in U.S. Congress, House Committee on Science-, 
Space, and Ibclinology, The Hearinf^s on Adequacy. Direction, and Priorities for the American Science and Technology Effort, lOlsl Cong,, Feb. 
28-Ma/. 1. 1989 (Washington, DC: U S. Goverrjiicnt Printing Office, 1989). pp. 1-2. 

^^VoT example, see David Baiimvorc, "The Worsening Climate for Biological RescATch/* Technology Heview. vol. 92, No. 4, May-June 1989, p. 22. 

^Ai the agency level, tradec.rs are made routinely within research programs, and ' 'peer review' ' informs ibc project choice of many programs, making 
them f <:countabic to specialized research communities. When criteria in addition to scientific merit are included in peer reviews, however, selection 
mechanisms can ome under duress. See Margaret Jane Wyszomriski. "The Art and Politics of Peer Review," Viintage Point, spring 1990. pp. 12-13. 
For recent appraisals of selection mechanisms and agency accounubility for them, see U.S. Congress, House Committee on Science and IK^Lnology. 
T^lt Force on Science Policy, Research Project Selection, vol. 17. hearings. 99th Cong.. Apr. 8-10. 1986 (Washington, DC: U S- Oovemmrn; Printiiig 
Office, 1986); and National Science Foundation. Office of the Inspector General, Semiannual Report to Congress, No. 2, Oct. 1, 1989-Mar. 31, 1990 
(Washington. DC; March 1990). 

^^Govcnimcnt- University-Industry Research Roundtablc, Science and Technology in the Academic Enterprise: Status, Trends, and Issues 
(Washington, DC. National Academy Press, Oclobcj 1989). p. 2-32. More qualiutivc information is needed to undentand the conlcxu of research 
performance and to inlcrp/ct the quantitative esiirrutes of time aiul expenditures reported in various National Science Foundation surveys. For example, 
see National Science Foundation. Scientific anii Engineering Research facilities at Universities and Colleges: 1990 (Washington, DC: September 1990). 
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their costs from the Federal Government by charging 
more items to direct costs that were formerly part of 
indirect costs.'^ 

Third, addressing the changing demands on the 
educational pipeline (K-12 through graduate study) 
for science and engineering will be vital for main- 
taining strength in the performance of research. 
Through the direct support of graduate students and 
the indirect support of research institutions, the 
Federal Government is pivotal in the creation of a 
robust research woik force. OTA has documented 
the initiatives needed to maintain t)ie readiness of the 
educational pipeline^ Recruitment and retention 
programs can respond to changing demands for 
researchers and enhance preparation for diverse 
caieer opportunities for graduates with science and 
engineering Ph.D.s,^^ 

Human resources arc tlie principal component of 
the research system. Increasing participation in 
research by those groups chronically undenepre- 
sented in science and engineering (women, ethnic/ 
racial minorities, and the physically disabled) and 
those acutely affected by resource constraints (e.g., 
young investigators, see box 2-E) is a challenge to 
the goal of enlarging capacity in the Federal research 
system. The Nation (not just science and engineer- 
ing) gains from the flow of new Ph.D.s into this work 
force. The character of the flow (not just its 
intensity) will determine the robustness of the 
resciu'ch system in the 1990s. 

Finally, filling gaps and reducing uncertainties in 
policy-relevant information i.s essential for better 
informed decisionmaking. NSF is defined as the 
Federal agency . . to make comprehensive studies 
and recommendations regarding the Nation's scien- 
tific research effort and its resources for scientific 
activities. Empirical knowledge about the Fed- 
eral research system hr*^ grown immensely, yet each 




Photo cr$dft: U.S. Otpartmmt oi AgrkuJturB 



A researcher studies the growth of a plant. Increasing 
the participation of traditionally underrepresented 
groups In science and engineering will continue 
to be a focus In federaily funded research. 

of tlie three issue areas outlined above suffers from 
a lack of some appropriate data on which to base 
Federal policy. 

New research indicators are needed as a means of 
monitoring change in the Federal research system.** 
OTA has also found (see chapter 8) that the 
evaluation of research projects would add to the 
investment decisions of policymakers and program 



^For example, sec C Cordcs, ' ' Universities Fear That U S . Will Limit Payments for Overhead Costs Incuncd by Researchers, ' ' The Chronicle 
of Higher Education, voi. i/. No. 12. Nov. 21. 1990» pp. A19. A21. For a university perspective, see Association of American Universities, indirea 
Costs Associated With Federal Support of Research on University Campuses: Some Suggestions for Change (Washington, DC: December 1988) 

•^"^Sec three reports by U.S. Congrws. Office of Tbchnology Assessment: Educating Scientists and Engineeers: Grade School to Grad School, 
OTA-SET077 (Washington, DC: U S. Government Printing Office. June 1988); Elen^entary and Secondary Education for Science and Engineering, 
OTA-l'M-SET-41 (Washington. DC: U.S. Government Printing Office. December 1988); and Highe ' Education for Science and Engineering, 
O IA-BP SET'52 (Washington. DC: U.S. Government Printing Office. March 1989). 

^^^Thc National Science Foundation was tfius named the agency datf liaison and monitor. For the scopeof these rcspowiibilities. sec especially sections 
2-3 and 5-8 of Executive Order 1052 1 . reproduced in J. Meiton England. A Patron for Pure Science. The National Science Foundation's Formative Years, 
1945^57 (Washington, DC: National Science Foundation, 1982). app. 1 . quote from p. 353. 

^ 'For example, sec Carlos Kruytbosch and Lawrence Burton, ' 'The Search for Impact Indicaton. ' ' Knowledge: Creation, Diffusion. Utilization, vol. 
9. December 1987. pp. 168-172. 
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Box 2-E— The Perils of Being a Young Investigator 

"'llie next generation." "The seed com/' "The future of scientii^c research." lliese are some of the words 
used to descril)c young investigators. Current commentary on the funding of research grants, especially in 
biomedicine and by the National Institutes of Health (Nm), centers on the fate of young investigators.' lliis 
conunentary undersvires the unity of training iuid research, yet suggests llie strain experienced by a growing 
segment of the research work force. 

Many see the problems of young investigators as a natural adju.stmenl of the research labor market to greater 
competition in funding or to changes in the structure of research teams, hi the words of Rockefeller University 
I^resident David Baltimore: **How much growth in biomedical reswirch personnel is needed and how much is 
healthy? "2 Others see the plight of young investigators as stemming from problems in fur ding allocation 
mechanisms. Recognizing that the young investigator with little or no track record is at a di.sadvaiuage in 
head-to-fiead competition with .senior investigators for Federal research funds, lx)th NIH and the National Science 
Foundation (NSR have establi.shed mechanisms that narrow the pool of eligibles, NIH's First Independent Re.search 
SupjK^rt iUui Trmisition (I*IRST) awards grant 5 years of .support, not to exceed a total of $350,(KX), to successful 
first-time applicants to NIH.^ Begun in 1987, recipients of FIRST awards (R-29s) have indeed fiU'e<l better tlian other 
young investigators in competing for^aditional individual-investigator (ROl) funds. In fiscal year 1988, one-half 
of the R29 awardees were under .36 years of age, compared to 14 percent of ROl recipients, and 23 percent of tlie 
young ifivesligators were female compared to the 14 percent of traditional NIH grant recipients.'* Periiaps the best 
news for tho.se who monitor award trends is that once young investigators get an NIH grant, they win renewals as 
often as senior investigators.^ 

At NSF, the much-heralded (now 7-year-old) F^residential Young Investigator (PYI) program awards 5 years 
of funding/' PYIs are augmented in two directorates by Research Initiation Awards. These provide up to $100,000 
for 2 years, including an institutional matching incentive to [jelp defray equipment costs. In 1989, 726 applications 
were received; 17 j-jercMit were funded, 'lliis constituted mild relief from tlie slim success rates, roughly one in five, j 
that first-time applicants have experienced since 1984 throughout most NSF programs. (More seasoned 
investigators have succeeded during that perio<I at a late of one in three. 

New PhDs **ilch," in the words of one, to establish their owii laboratory, attract graduate students, and produce \ 

experimental results. The goal is to replicate the career pattern of one\s mentor. But, can every young investigator j 

become a PI? Iliis will bring more proposals, more competition, more demands for research funds. A young i 

investigator with an excellent NIH priority score for her proposal but no money says: Wlien we slam up against [ 

this problem, we have self-confidence to say Mhis is unjust * not *1 am unworthy.* In a way, it takes aji egoist to j 
persevere."** 
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•llicir (KTils were Uic tn;ijor sublcxl, for example, i\i ihe N.'Uit m M ^^.cicnccs/ln.siitulc of Mailt ifie, "F*onim on Support in>! 

Biomcilical Research: Near Ttnii Problems atui Opliorj.s ff^i Ac!iot> s^. . June 27, 1990. \i\ addiuon, (he Nanonal Rcsejirch 

Council's Comrnissjon on Life Sciences is stmlyin^ ihc lunding of y» *&itj?-..ors. A report i.^ due in fail 19*^1 .Sec **ScicntisLs Explore 

Ways To Help Young Re.<e arc hers," NewsReport of the NiUnmal Res. nw til vol 4(). Au^^u.si-Scplenibcr 1990, pp. 

^Quoted in *'NUi Crowd Seeks New Ways Out oi Money Cnjnc . ' . tence (invernmefit Report, vol. 20. No. H, Aug. I . p. 2. 

\Sec Joe Palta. "NSF. NIH Apply Band-Aids." .SV/p/»rf. vol. 249. J''.iy 11, I9W. p .i^2 

•^National In.siilulcs of Hciillh, Uivij^ion of Research OraiiLs. '^DncfinkJ! i>n NUl MRS'I AtUvity.'* spiuig 1989. pp 6. 15, 18 
**l'alca, op cil . foolnolc 1. 

^""Ihis program awards about 200 grAULs per yeiu wjlh the expcciadon llwi (iuring the Vycar f>ciiod industry fundui^j will Ik secured lo 
solidity the lovesligutor's reseureh program aiid il.s impiicl. Even wilh indu.sinal fundm?,. however, ihc researcher is likely lo apply for rcguhu- i 
gmnl support A National .Science Foumlaiion lask force has recently recon>niended vutling the nunitxir of Presidcniial Young Inve^sdgator ' 
awarded by one-hali. incrciising ihe award amount and dropp'Mg tlic rmilchin^ fund rct|(iircment. as well as amending the application proc*ess i 
to include a tull-blown propo.sal instead of nominating and endorsing letters irom mentors arv* other senior investigators. See P:uiicla Zurer. I 
'"N.SF Young Investigator Program May Be Slashed." "h^nxical A Enf^invvnt^^ Sens, vol. 68. No. .M). Dec. JO. 1990. p. 7. aiid "Presidential 
Young Inveiiiigalors" letter, (^hemiail ^ Engincennt^ i *ws^ vol. 6 H. No. 50. Dec. 10. 1990. p ^. I 

^Joc Palca. *'Young Investigators at RisK" Sneme^ vol 249. July 27, \^X\ p 35.^ the Naiioiutl .Science F-oundalion also tcpons "new j 
mvesligaior awards/' i e . awafd.s to applicants not funded hy NSf ir^. the previous S fisc^tl ywirs Since 1984. 20 to 25 percent o( total awards : 
were tnude to new investigators See Manpower Conimems, vol. 27. No. 5. June i^>*X). p 31 I 

'^Piilca. op cit . fo<)ln<3le 7 A junior faculty member at the Salk Institute add.s. "I worry txrcau.se the NIH c:m'l he trusted Hie tighter the | 

luiiding at NIH. the greater the chance your grant will l)e killed by bad luck not because it isn't giMul science " Ann (iiblwns. "llieSalk Iiisiituic | 

at a(*H)hsroads.".Vnf/ic«'. vol. 24^, July 27. 1990. p Uil ' 

Continuod on next page \ 
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Box 2-E-*The Perils of Being a Young Investigator— Continued 

Another tack is to be (reluctantly) pragmatic, **. . . buttering up senior researchers and NIH review panel 
members who could help their chances of getting funded . . . When good science could get you a grant, you didn't 
need to do it. Now you have to, and that's turning many people into cynics.*'^ Is the next generation to be the ernes 
who feel deceived when the system does not work for them die way it was ''supposed" to? This is a question <tf 
expectations. A recent survey of young physics faculty at all 175 physics Ph.D.-grBnting universities in the United 
States (conducted by the American Physical Society) adds another perspective to gauging die plight of the young 
investigator. In 1 990, 70 percent of the young jrfiysics faculty reported that research funding is inadequate, whereas 
in 1977 less than 25 percent responded similarly. Of the 1990 young Ph.D. faculty who submitted **start-up** (i.e., 
their first) proposals, condensed matter frfiysicists submitted the largest average number of proposals (over five), 
and experienced the lowest success rates (25 percent). All otixct subfields had success rates from 38 to 55 percent. 

The report concludes that '\ . . . there haa been a major change for the worse in the research climate.** For 
condensed matter physicists, most of whom consider NSF the dominant source of support, this may be true. But 
the perceptions do not generalize across all subfields. Indeed, both 1977 and 1990 young frfiysics faculty 
overwhelmingly ''would recommend physics" and would choose to pursue a career in physics again. In additicm, 
twice the proportion of 1 ^77 young faculty claimed that the ''job market was worse than expected" than reported 
by the 1990 young faculty (61 percent to 31 percent)," 

The merits of additional support to young investigators cannot be overstated. How this is to be achieved poses 
formidable challenges to research agencies and program managers, as well as to the scientific community. All 
contribute to the expectations and the standards for measuring the research performance of new Ph.D.s. For those 
young investigators who embark on academic research careers, the (^ospect of a FIRST, PYI, or Research Initiation 
award is vital if they are to become senior researchers. NIH and NSF face choices, too, in shaping researchers' 
expectations. These choices might include: 

• limiting the amount of Federal funding that goes to one principal investigator, taking into account all sources 
of Federal research funds and cost differences among fields; 

• addressing policies at some universities that prohibit nonfaculty personnel from applying for Federal 
research fiinds as principal investigators, and encouraging these universities to lift such bans; 

• requiring the sharing of doctoral students and instnimentation; and 

• encouraging universities to restrict the number of refereed publications considered for promotion, tenure, 
and other awards (to decrease the amounts of Federal funding required to publish longer lists of research 
papers).*^ 

^PaJca, op. cil.. footnote 7, pp. 352-353. 

l^ic quesuoimairc was ciaulalcd to 939 physicists who earned a Ph.D. degree In 1 980 or liter and then received academic appointments. 
The response rate was 71 percent. Sec Roman Czujko et al., Their Most Productive Years, Repon on the 1990 Survey of Young Physics Faculty 
(Washington, DC: American Physical Society, 1991) (reprinted in Physics Today. February 1991. pp. 37-42). 

l^Condefised matter physicists represented the largest subOeld (one-third of the total respondenu) in the 1990 sample. Ibid., uble 3. 
»2ibid.. table 5. 

^^For discussion of these and other ideas, see Institute of Medicine. Funding Health Sciences Research: A Strategy To Restore Balance 
(Washington, DC: National Academy Press. November 1990). For insight into the contentiousness that greeted the Institute of Medicine report, 
sec Peter G. Gosselin. ' ' A Clash of Scientific Tiums; Key (Jroups Battle Over Funds for Medical Projectt." The Washington Posu Health section. 
Dec. 18/25. 199(1. p. 6. 
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support slruelure and creating policy-useful indica- 
tors and evaluations could ass«st policy formulation 
by both the legislative iuid executive branches iuid 
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help to inform decisionmakers about the effects of a 
changing research economy on research priorities, 
expenditures, and performers. Information, how- 
ever, is not cost-free. Additional funding both for 
agency data collection and analysis, and extramural 
* 'research on research," may be a necessary invest- 
ment in the Federal research system of the 1990s, 

In the chapters that follow, OTA delineates the 
participants and their roles in the research system. 



After introducing this decentralized system — how 
the executive and legislative branches negotiate 
national goals and the Federal budget, and how the 
agencies determine the allocation of research 
funds — OTA assesses the challenges to managing 
federally funded research. 



ERLC 



CHAPTER 3 



The Federal Research System: 

The Executive and 
Legislative Branches 




ERIC 



Contents 

Introduction 71 

Tlic Executive Branch 71 

The Science Advisor 74 

Office of Management and Budget 77 

Fxternal Advice and Interest Groups 78 

'I'he Legislative Branch 81 

The Congressional Cornmiliee Structure and the Budget Process 82 

Congressional Oversight 86 

Congressional Earmarking 87 

Conclusions 93 

Boxers 

3^A.()MB and the Research Budget 78 

^ B. New Layers of Complexity for the Federal Budget 19 

Hgur(»s 

VI. Science Advisors lo the President, 1932-90 73 

3-2. Apparent Academic EitJ"nuu*k>' by Stale and at Universities and Colleges: 

l-i.scal Years 1 980-89 93 

Tables 

3-1. Congivssional Authorization Committees and Appropriations Suhcoinniiltees 

With Signitlcimt Legislative Authority Over R&D 83 

3-2, Apparent Academic Earmarks: Fiscal Years 19S()-89 9() 

3-3. Appiu^ent Academiv Earnuuks. by Appropriations Suhcoininittec: l-iscal Years 

P>8()-9() 91 

3-4. Ap(nu*ent Acatiemic Earnuu'ks Coiuanicd in the F'iscal Years 1980-89 

Appropriations. Ranked by Stale 92 



ERIC 



CHAPTER 3 

The Federal Research System: 
The Executive and Legislative Branches 



In the final analysis, after science and technology decisions have been subject to the 
judgment of conflicting objectives, , . . they are then subject to the reality of the Federal 
budget process. First research and developmeni programs must compete with other 
F ederal programs for the availability of limited Federal dollars . . ,for there wilt always 
be more programs and projects than there will be funds to implement them. Thus another 
set of choices in how to allocate the funds to gain the greatest benefits must be faced, 

Don Fuqua^ 



Introduction 

It is often siiid thai the best scientists not only 
know how to solve problems, but how to pick them. 
Choosing where to put valuable time and resources 
is central to the success of any scientist, laboratory, 
or university. The same is true for the Fcdeial 
Government. 

Decisionmaking occurs on mmy levels within ttie 
Federal research system. The most macroscopic 
level for research decisionmaking concerns a si:>ec- 
trum of general resciu'ch problems such as space 
exploration, aging, or AIDS (acquired immunoilefi- 
ciency syndrome), llie lYesident and Congress are 
ultimately responsible for decisions made at this 
level At mid-levels, the focus shifts to fields such as 
astrophysics, virology, or artificial intelligence. 
Most often Federal agencies jmd specific congres- 
sional committees take the lead in these dex;isK/ns. 
Priorities within a single field of science or teclmol- 
ogy usually involve specific govenmient programs 
and congressional sulx^ommittees. And, finally, at 
tlie most microscopic level, the focus is on aieas of 
research specialization and often involves specific 
processes of funding allocation.-^ 

A focus of this report is the tiemendous diversity 
within the Federal Go* ernment in tJie selection of 
priorities fur research, bvery Federal agency and 
congressional committee seems to do it differently,^ 
If the govenuncnt is to respond to changing fiscal 



conditions, many choices witliin ti\c organization 
and management of the reseaich budgets must be 
made. 

This chapter discusses the highest level of deci- 
sionmakers — the President, the executive branch, 
and Congress. (Chapter 4 inirixiuces tlie Federal 
agencies and other participating bodies.) Although 
in this discussion the executive and legislative 
branchfes are treated sep;irately, tliere is important 
interaction between them, both fomially at congres- 
sional headings and executive branch bnefings and 
informally among staff. 

The Executive Branch 

When President Bush awarded the National 
Medal of Science and the Nationiil Medal of 
Technology to 30 sciemists and engineers in No- 
vember 1990, he remarked: 'Mote and more our 
Nation depends on basic, scientific research to spur 
economic growtli, longer and healthier lives, a more 
secuie world mid indeed a sal'er environment.'"^ 

Traditionally, Presidents have been very supi)ort- 
ive of science and engineering, or what is categori- 
caJly known as research and development (R&D). 
However: 

Bvery administration refers each year to its 
**R&D budget,*' which is described in various 
documents — most notably. Special Analysis J, pro- 
duced by the Office of Mimagcmenl and Budget. In 
actuality, there is no Federal R&D budget, if by 



'Don Futjua, "Scicikc Policy. Tlie Rvoluiion of Aniicipalion/* Tfchnolo^y in Society, vol. 2, 1980, p. 372- 

^For overviews, sec Bruce L k. Smith, American Science Policy Since World War II (Wa&luogton, DC;. Tlic Brt*ok«i^)[is lusiituliou, 1990); an<] David 
DicL^on. The New PoUiicx of Science (New York, NY. Pantheon, 19&4). 

^AihI viewed in a .:ross-na\Mo[ial framework, ihr U.S. reftcnnch system is disiH>clivc. Sec app. D for a dwcussion of priority setting in other countficfl. 

Quoted m *'Natioiuil Medal* Are Pinned cm 3<) Scientwrs,** The Washington Pou, Nov 1990. p. A23 
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The House Commltteo on Agriculture, which has Jurisdiclion over the Doparlnient of Agriculture and Its research programs, votes. 



**budget'* is meant a plan for rnairhing priorities 
with spending. What each administration presents to 
the public is an after-the-fact compilation of the 
R&D s()ending plans of the individual mission 
agencies mul NSI'\ plans that were developed 
through a complex and fragmented sequence of local 
interactions among individual groups ith the agen- 
cies, the While House Office of Science and 
Technology Policy, and a slew of congressional 
connnittces.^ 

T\\c most consistent indicator of IVesidcntial 
priorities over the last 30 years has been the 
Presidential Budget Message, presented to Congress 
every yeiir, which accompanies the Presidential 
budget. A review of these uocuments, extending 



back to the Kennedy Administration, gives an 
interpretation of Residential direction, at least 
rhetorically, of the Federal research system.^ 

Durini* the 1960s, tlic mastery of space and space 
science, as symbolized by a manned lunar landing, 
was a central mission. Competition with the Soviets 
both in research and economically was the center of 
the debates. Domestic research needs received 
increasing emphasis from 1964 through 1968, linker! 
to the programs and aspirations of the Great Society, 
but tempered by economic constraints stemming 
from increasing involvement in Vietnimv Pollution 
also became a major item of concern from 1964 
onwiird. Specific research emphases included: 
National Aeronautics and Space Administration 



^Joseph (i Moronc. "Fctlcral R&D Slruclurc. TIk Need for GiaJigc," The liriJfie, vol. 19. fall 1989. p. 5. Special Analysis J waa discontinued in 
1990. but is discussed below. 

^*hc following IS teed on Mark Pollack. '•Dasu: R.jscan:h Goals, rcrccp Jons of Key Political Figures." OTA contractor report, June 1990 
Available through tlic N?uional 'Ibchr». •'d Information .Service, hoc app. F. Readrrs will note below llie lumping of "K** and "D.'* well a.s the lack 
of distiiuriion UMwcen •*bii.su:" and ''applied*' rcseiirch llic inutfo vie*v »*:eki Uic big picture, e^ . R&D relative to tiansporlaUon, vctcraas' affairs, 
and other national needs RennementJit come hi later clwpters 



ERLC 



Chapter 3— The Federal Research System: Vie Executive and Legislative Brar)ches • 73 



(NASA) pursuit of manned flight, planetary probes, 
and scientific satellites; National Science Founda- 
tion (NSF) support of facilities at universities and 
colleges to strengthen science education; health 
research, including the prevention of cancer, heart 
disease, strokes, mental illness, mental retardation, 
and environmental health problems; environmental 
research, including resource conservation and devel- 
opment, oceanographic studies, and water and air 
pollution abatement; transportation research; and 
defense research. 

During the 1970s, as space flight and research 
were scaled back, energy research issues became 
increasingly prominent, emphasizing the develop- 
ment of energy alternatives and the improvement of 
existing ones. These issues were linked to growing 
concern about dependence on foreign oil, and also to 
environmental concerns of pollution and conserva- 
tion of natural resources. Specific energy research 
programs were emphasized by President Nixon and 
others, including fusion power and geothermal and 
solar energy. President Carter stressed conservation 
and alternative energy sources and advancement in 
nuclear power technology. Defense research was 
consistently supported, and preservation of national 
economic preeminence remained a strong goal on all 
fronts.^ 

During the 1980s, economic recovery, competi- 
tiveness, and leadership were the rhetorical focal 
points of discussions of the goals and justifications 
for research. Specific attention to the category of 
**basic re«carch,** begun in Residential addresses 
during 1978, was linked to goals of economic, 
military, and technological leadership (although 
these goals were not necessarily reflected in the 
distribution of research funds, e.g., defense basic 
reseiirch funding did not increase markedly in the 
1980s). In the Presidential messages of 1982 to 
1986, the shift of Federal aid to scientific research 
and away from application and development became 
explicit. Cuts in applied energy research and agri- 
cultural sciences were made, while basic energy, 
defense, and biomedical research were augmented. 
In the late 1980s, as in the early 1960s, big science 
research projects were feature<i on the Presidentiid 
agenda. The Space Station, the Strategic Defense 




Photo cr9dtt: Jmi^ Nottf, OTA stafl 



Tho President can be a major architect of the research 
system, and some Presidents have shown more Interest 
In research and development Issues than others. 

Initiative, AIDS, the Human Genome Project, and 
the Superconducting Super Collider (SSC) all fig- 
ured prominently. 

American Presidents of the last three decades 
have paid heed to maintaining the science base — the 
broad spectrum of researchers and research sup- 
ported by the Federal Government — but have also 
felt the need to concentrate resources toward achiev- 
ing stated research goals. During the 1960s, when 
research budgets were increasing rapidly, the Presi- 
dent could add new objectives to the system while 
maintaining other research programs. Now, Presi- 
dents must make more choices in fiscal allocation. 
For example, President Reagan distinguished be- 
tween basic and applied research, favoring the 
former with budget increases and decreasing the 
latter in specific areas such as energy. (Under the 
Bush Administration, this distinction faded and 
several applied energy projects have been pursued.) 

However, Presidents have generally been less 
involved in decisions about research policy than in 
areas such as economic, space, or defense policy 
(with the possible exception of decisions about 
particle accelerators). Until recently. Presidents 
often viewed research as within the purview of 
specific agencies, intertwined with the development 
of technologies and the procurement of certain 
goods or services, but rarely a policy objective per 
se. To keep abreast of research issues, the Resident 



^David Birdscll aikl Herbcn Simons. "Basic Research Goal.v A Conipari.son ol Political Ideologies/' OTA contmctor report June 1990- Available 
through the Nalioual Tfechnicff.^ Information Service, see app. 
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relies on many groups including the Office of the 
Science and Tfechnology Policy (OSTP) and the 
Office of Management and Budget (0MB). 

The Science Advisor 

Science Advisors most often have impeccable 
technical credentials and extensive experience 
within the scientific community* (see figure 3-1). 
President Eisenhower appointed James Killian the 
first titled Science Advisor in 1958. At present, D. 
Allan Bromley holds that position. He is OT^cal of 
past science advisors: physicists with outstanding 
research records and a history of participating in 
government advisory committees on science and 
technology.^ Advisors over the last 30 years have 
come from industry and university settings. 

One criticism of Science Advisors has been that 
they favor the physical sciences, while Presidential 
goals have included life and social science objec- 
tives as well.^^ Another criticism of the position is 
that, while acting as the representative of the 
President, advisors are also seen as allies of the 
science community from which they were recruited, 
expected to give advice on all scientific matters as a 
•'scientist." This dual role can be difficult. Some 
advisors, notably Keyworth and Giaham in the 
Reagan Administration, were regarded as outsiders 
by the scientific community. They were less trusted 
and seen more as voices articulating the President's 
ideologiciil agenda. 

Since the Office of Science and Ttchnology 
Policy Act in 1976, the Science Advisor has also 
been the director of OSTP.'* OSTP was created by 
Congress to strengthen the role of the Science 



Advisor by creating a position that was parallel to 
the Director of OMB and the Chairman of the 
Council of Economic Advisors.^^ OSTP currently 
includes a small staff— less than 75 — with a portion 
of the personnel detailed from various Federal 
agencies. With the confirmation of a new advisor 
(which usually coincides with the beginning of a 
Presidential administration), a new OSTP staff is 
assembled. Consequently, few senior OSTP staff 
will serve in their positions for longer than 4 to 3 
years. However, many have extensive experience 
within the executive branch. Congress, or the 
scientific community. While this staff turnover 
requires that the Science Advisor and OSTP ••start 
from scratch" and provides limited institutional 
memory, it also allows OSTP to construct a new 
agenda with each advisor. 

In addition to providing a resource for scientific 
and technical information for the President, the 
responsibilities of OSTP include coordination of 
R&D activities throughout the agencies. The Federal 
Coordinating Council on Science, Engineering, and 
Tfechnology (FCCSET). under the chairmanship of 
Science Advisor Bromley, provides a forum for 
coordination.^^ Bromley has paid sp<"tcial attention to 
FCCSET during his tenure, increasing the participa- 
tion of senior agency personnel. In 1989, there were 
nine active FCCSET committees.^^ 

The Science Advisor also chairs the President's 
Council of Advisors in Science and Tfechnology 
(PCAST), which provides independent expert ad- 
vice to the President, PCAST was created in 1989 in 
the image of the President's Science Advisory 



•William Golden. Science and Technology Advice to the President, Congress, and Judiciary (New York, NY: Pergamon Press. 1988). 

^James Killian was a notable exception. He wvus trained a.i a hunianist who rose through the ranks at the Mamctiusetts Institute of Ibchnology as 
an administrator. He was accepted into the scientiHc community and treated as iJi equal member. Harvey Brooks, Harvard University, personal 
communication. February 1991. 

i^ln an interview soon after his appointment, Bromley admitted the overrcpresentation of physical scientists on such bodies a.s ttte President's ScierKc 
Advisory Committee, pointing out that ". .. the life sciences must be brought in more strongly tlian ihcy are now.*' Sec Jeffrey Mervis, * 'New Science 
Advi.sor Sees SUong Ties to Bush, Public Support as Keys to Job," The Scientist, vol. 3. No. 1 1, May 29. 1989. p. 3. 

' 'The forerunner of \Ue Office of Science and Ibchnology Policy was the Office of Science and Ibchnology (OST). The posiuon ot OST director wi*s 
crcate^l by President Kennedy in 1961. 

^^Richard C Atkinson. ^'Science Advice at the Cabinet Ixvcl." in Golden, op. cit., footnote 8, p. 12. 

"For a history of the Federal Coordinating Council for Science, F-ngincertng. aiul Ibchnology, see Congressioiul Research Service, Interagency 
Coordination of Federal Scientific Research and Development: The Federal Councd for Science and Technology, Report to the Subcommittee on 
Domestic and International Scientific Planning and Analysis, Committee on Science and Ibchnology, U.S House of Representatives. 94lh Cong. 
(Washington, DC; U S. Government Printif)g Office. July 1976). 

^^Gencvievc J. Kne/.o. "Wtiiie House Office of SciciKe and Ibclmology Policy. An Analysis." CRS Report for Conf^ress (WasWngton, DC: 
Congressional Research Service. Nov. 20, 1989), pp. 61-62. 
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Figure 3-1— Science Advisors to the President, 1932-90 
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«^McTa^u« was acting Science Adviaof b«twoen Koyworlh and Grafiam. 

SOURCH: Acmpt«nrofn Wlliam G Wttlto. ScJiooi Df Govifnni^nt and Buamess Admin.slrat.on. George W.ishmr/on Un.versily. "ScierKe AdVK:e arKl the Pfo.Klency. 1933-76." unpublished 
uissertation, 19//, p 18 * f 
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Committee (PSAC), which had been disbanded by 
President Nixon in 1973.^^ (Although the authoriza- 
tion to constitute a new PSAC was included in the 
1976 legislation which created OS TP, no action was 
taken until 13 years later,) Members of PCAST, 
appointed by the President, are distinguished leaders 
in science and engineering from industry, philan- 
thropy, and academia, Although PCAST can be 
asked to comment on specific scientific and techno- 
logical matters, it can also offer opinions on other 
issues jmd solicit its own outside analysis. (PCAST 
has only been in operation for a little over a year, so 
it is difficult to determine the role that it may play in 
the 1990S.16) 

PCAST, OSTP, and the Science Advisor are 
advisory to the President. As such, they have not 
been given much power. As a former staff member 
in the George Keyworth-led OSTP writes: 

The position of the President's Science Advisor 
(and director of OSTP) is strictly a staff function, 
with no line authority and no control over budgets. 
The primary tool available to the President's Science 
Advisor is persuasion. How effective he is in 
convincing agencies to shape or modify their R&D 
budgets depends largely on tlie s' engih of his 
personal relationship with inner circles of tlie Wliile 
House. 

Two general comments can be made about the 
roles of these advisory bodies for the next decade. 
First, global problems such as climate change and 
pollution involve issues of cooperation and plan- 
ning, while President Bush's goals for science and 
matiiematics achievement by the year 2000 high- 
liglil the urgency of education and human resources 
for the Nation's vitality. Both will require domestic 
policy coordination, and tough resciu-ch funding 
tradeoffs may be needed. Second, while the role of 
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TTie Old Executive Office Building is home to much of the 
Office of Science and Technology Policy and the Office 
of Mana9enf)ent and Budget. 

science advice will not wane in the 1990s, it is 
unlikely that the role of thr: Science Advisor, OSTP, 
or PCAST will be strengthened legislatively. To 
somij, OSTP has to . . brighten its image on the 
White House poHtical screen. ''^^ Yet, in the execu- 
tive branch where influence is often equated with 
budgetary control, the advantage resides primarily 
with the research agencies and OMB. 



'^C!rcale<J by PrcJiidenl EL^cnhowcr in 1957 afler Sputnik, the f*rcsulent*s Science Advisory Coniniilicc (PSAC) relocated ^\cux ? ^vice fiom tlie 
Office of Defease Mobil i/ation to \\\e White House. Among il.s first actions, PSAp proposed cstabhshing a counteipart group of rcpresciilwuves fronn 
tlic F'cdcral research agencies to improve coordination of ibc Nation's RAD effort. The result waj the founding, in 1959, of the Federal Council for 
Science aiKl Ttchnology. See Ralph Sanders and Fred R. Brown (cds.). Science and Technology: Vtial National As^fis (Washington, DC: Industrial 
Collcgr of the Anncd Forces, 1966). ch. 5, especially p. 76. 

^^Suc Jeffrey Mervis, * ' PCAS1* Members Ready to Speak; President Seems Ready to Listen," Thf Scientist, vol . 4. No. 1 0. May U. 1 990, pp J . 1 4- 15 
One role that the President's Council of Advisors in Scietice and Ifechnology lias alieady played is defining a pool of cligibles for key R&D agency posts. 
From an)ong its 12 members, President Bush nominated physicist Walter Massey lo head tlic Natioiml Science Foundation and cardiologist Bcrnadittc 
Healy as director of the National Institutes of Health. 

'^Morone, op. cil.. footnote 5. p 6 

'•^-^iiesay this is already occurring under Science Advisor Bromley, who is tiic first Science Advisor clcvalcd to tlie title of Assistmitln IhePresiacnt. 
Rob- • w.wcig quote<l ii» A Good Budget for Science, But Troubles Lie Mxca^,'^ Science and Government Report, vol. 20, No. ly, Nov 1 5, 1990, 
n ? 
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Office of Management and Budget 

Research budgets are strongly influenced within 
the Executive Office of the President by OMB. As 
Science Advisor Bromley has remarked: '*It became 
evident a long time ago that if you control the 
budget, you control public policy. This is one of the 
facts of life that a science advisor must leam, tliat 
OMB is a tough player and not necessarily sympa- 
thetic."*^ OMB crafts the budgets of research 
programs to reflect the priorities of the President,^*' 
and helps to set realistic targets for thie next year's 
budget in all research programs while attempting to 
balance the competing needs of the Federal depart- 
ments and agencies. 

The manner in which these concerns are negoti- 
ated with the agencies is left to the discretion of the 
OMB budget examiners. Budget examiners con- 
cerned with research are located in at least three of 
its six divisions: Natitral Resources, Energy, and 
Science (which includes NSF, agriculture, and 
space); Human Resources, Veterans, and Labor 
(which includes health and education); and Nation- 
al Security and International Atfairs (defense). 
Through Special Analysis J, OMB traditionally 
presented proposed R&D agency budgets for the 
new fiscal year. The publication of this analysis was 
discontinued after the fiscal year 1990 budget, but 
since that time, R&D has been discussed (with the 
information traditionally presented in Special Anal- 
ysis J) in a separate inu^oductory chapter to the 
President's budget.^' 

OMB's role in research priority setting and fiscal 
allocation is not public. The deliberations of the 
agency are internal, building on agency submissions 
preliminary to OMB decisions (see box 3-A). 



Behind-the-scenes negotiation between OMB exam- 
iners and agency budgeters is common. This closed- 
door policy minimizes contention, and perhaps 
stifles controversy, both within and without the 
government on specific funding issues. 

A strong perception of OMB standards and 
policies on research has grown up outside of OMB 
and die executive branch. Most importantly, many 
observers state that OMB has an active role in 
deliberations over research agendas, particularly in 
support of projects such as the Space Station and the 
SSC. New progr^s, especially Presidential initia- 
tives such as the Moon^lars mission, require that 
OMB be involved early in the fiscal process. But 
because these deliberations are shielded from public 
view, critics claim that these policies are not 
sufficiently debated. 

The fiscal 1991 budget act placed a separate cap 
en discretionary spending in three budget catego- 
ries; defense, domestic, and international programs. 
These caps limit spending for each of fiscal years 
1991 through 1995 and specify methods of enforcing 
deficit targets. The caps will force tradeoffs within 
each category of the budget; this will effectively 
reduce flexibility and foster more negotiation within 
the executive branch (i.e., among OMB, OSTP, and 
the agencies) in the allocations ^or specific pro- 
grams.^ Members of OMB staff also stress, how- 
ever, that these caps will force greater priority 
setting based on the research issues, because the 
overall spending levels will be set.^^ Observers 
agree that the Omnibus Budget Reconciliation Act 
of 1990 has enhanced OMB's authoriiy relative to 
Congress because OMB **. . . will have a final say 
on cost estimates for all programs. (For furttier 
infomiation on the budget act, see box 3-B.) 



*^Mcrvi.s. op. cit.. footnolc 10, p 3. 

^nia Preiidcnt Bush, ihe Fcdejai Coordiiiaiing CourxriJ for SciCfKre. Engincerin|j! aiul Tbclinology and the .Sciciwc Advisor have paiticipaled in 
the implcmeniation of s<;vcral Prcjidentiai priorities, j^or the fiscal ycai 1991 budget, they included global cluuate ciiaoge, high-performance cooiputing. 
and maihctnatica and science education. 

^'Tbese uulyses, in turn, form the basis for an analysis and spring cotlooinii<n on rh<r R&D budget, h'eld in Washington, DC, and prMcnted by ihe 
American AssoctjtioD for the iXdvanccincnt of Science. These procc<'dings, tuited anJ published the following fill, serve an important interpretive 
function for the scientific community, relating the budget to topical issues in sdence Rn<5 technology. For tlie 1 5th annual proce^ings, see Susan L. Sauei 
(ed.), Sci€nc€ and Ffchnoiogy and the Changing World Order (Washington, DC: American Association for the Advancement of Science, 1990). 

2^Hugh Lowcth, "Science Advising and OMB.'* The Presidency and Saence Advising, vol Kcanelh W.ThompsoT^ (cd.)(Lanhara. MD; Uoivefsiiy 
i'ress of America, 1987). 

"Sec *Titlc XIII'-BudgcJ Enforvcinent,'* Congressional Record-House, Ocl. 26. 1990. pp. H 12743-H 12744, 
^Karl Erb, Office of Science and Ifechnology Policy, persoiuU communication, November 1990. 

^Robert Grady, associate director, Natural Resources. Cuergy, and Science, Office oi Management and Budget, personal comniunication, Feb. 7, 
1991. 

^Sec llvomas J. DcLoughry, "Deficil Reduction Plan Could ighien Budgeut for Student Aid and Reseaiclu The Chronicle of Higher Education, 
vol. 37, No. 10, Nov. 7. 1990, pp A18. A28. 
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Box 3-A--OMB and the Research Budget 



The Office of Management and Budget (0MB) reviews the budgets of aU Federal agencies before submission 
of the President's budget to Congress and performs crosscutting budget analyses, especially for topics of particular 
interest to the President. Traditionallyi 0MB has been very supportive of research in the Federal budget. This 
reflects the importance attached to research and development (R&D) in the budgeting process and the overall real 
and symbolic value of Federal research suppcM as an indicator of future planning and direction in government 
investments. 

Under President Bush and 0MB Dl^tor Darmani the process of planning the research budget has changed. 
Before the budget is collated, R&D is the subject of several separate briefings and d^led analyses of issues 
concerning research initiatives (e.g., funding for iridividual investigatCH's and big science projects on a case-by<case 
basis). The Federal Coordinating Council on Science, Engineering, and Ifcchnology (FCCSET) committees and the 
Science Advisor have also participated ext<»isively in the implementation of programs in several Presidential 
priority areas, especially global climate change, high-performance computing, and mathematics and science 
education. Important criteria for R&D invesunent used by 0MB include the support of excellent science and 
engineering, long-term competitiveness and economic concerns, commercial spinoffs, national {mstige, and 
''national security*' — in the broadest military and eomomic Sf4ise.^ 

In the budget process for fiscal years 1991 and 1992, 0MB asked the research agencies to submit budgets at 
five levels of hinding, which include scenarios with real cuts ^ well as augmented funding. In addition, 0MB 
requested that, for areas of particular Presidential interest, agency budget requests be '\ . . described and justified 
relative to the goals, objectives, and research priorities ... * * outlined in various framework documents, such as the 
U.S. Global Change Research Program.^ In areas not of highest priority, less crosscutting analysis is periformed, and 
the manner in whicn these concerns are negotiated with the agencies is left more to the discretion of 0MB budget 
examiners. 

Tradeoffs are made among agency programs, and between the ''research budget* * and other areas of domestic 
discretionary funding. Under the new budget agreement, when 0MB ''passes back* ' the agency budgets after the 
first review* 0MB has budgeted up to the caps detemuned for the agencies. If an agency* wishes to increase specific 
levels of funding, decreases to the agency tHidget must also be specified to allow the total budget to remain under 
the spending cap. Tradeoffs are then made explicitly among agency programs.^ 

In summary, 0MB provides a unique crosscutting function in research budgeting within the executive branch. 
Under President Bush, the implementation of research priorities has been accompanied by an increased role for the 
Science Advisor and the FCCSET committees.*^ In addition, general research priority setting has been elevated in 
the presentation of the President's budget. However, priority setting unrelated to targeted Presidential concerns 
remains primarily at the discretion of the budget examiners for the specific agencies, and tradeoffs are within agency 
budgets. 



IOTA mcetmg with Robert Grady. Joseph Hezir, and Jack Fellows. Oflice of Management and Budget, Feb. /, 1991. 

^Robert K Orady, Associate Director, Natural Resources. Locrgy. aiKl ScimK:^. Offlce of NfanagemenI and Budget. '"Ibiius ol Reference 
Memorandum on Ihc FY 1992 U.S. Global Change Research Rrcgram,*' unpubliolved document. June 18. 1990. 

^Ttie Darman Office of Management and Budget (0MB) was said lo consider RAD as yielding especially high future returns cn Federal 
mvesmient. lb thi^ end. the process instituted by 0MB encourages the research agencies to develop coherent proposals and discourages both 
within-agency disagreements and unresponsiveness of an agency to rbe requests of either 0MB or the Office of Science and Technology Policy. 
Ground rules and deadlines are spelled out in the **terms of reference*' issued by 0MB in every priority area designated for an agency crosscut. 

"^Part of this iocrea.sed Office of Science and Ibchnology Policy (and Officr of Management and Budget-reinforced) role has led to 
requests of the agencies for evaluative data. Of special relevance to this OTA report is the information gathering in progress on the ''structure 
of .science, ' ' an acUviiy of the Federal Coordinalii*g Council on Scicrwe. Engineering, and Ibchnology Committee on Riynictl MAthemctical. 
and Eoginecrir.g Sciences. 



(At(*rfial Advice and Interest (iroups 



[lolicy stnictufc that hikes into acccnmi a range of 
views on many decisions. Active cebate occurs both 
intornially and within the scieiUitlc hteralurc on 
programs, pohcies, and projects niitiaied by the 
[•ederal (lovenuneni, and this debate c)tlen intlii- 
ences )it)venuneni decisions. 



Much scientific and lechrncal advice is solicited 
from the scienlitic community by the executive 
brancli Tins p'iinnership between il)e scienlitic 
eoininunily and government has led lo a complex 
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Box 3-B— New Layers of Complexity for the Federal Budget 

A budget process many critics had said was too coinplicated has become even more so, thanks to sweeping 
changes adopted by Congress and approved by President Bush." Here are the major revisions to the 1985 Balanced 
Budget Act that will dramatically alter the way the budget will be drafted through fiscal 1995. 
Discretionary Spending 

For fiscal years 1991 to 1993, the law establishes separate ceilings for each of three categories of discretionary 
spending: defense, international aid. iuid domestic programs. If Congress chooses to increase spending for any 
discretionary program, it must offset the increase by cutting spending within tJie .same category,^ If it fail.s to make 
an offsetting reduction. cUi automatic spending cut— a sequester, in budget jargon— would slice enough from all 
other programs in that category to bring spending to below the ceiling. 

'Hie spending caps in billions of dollars, are as follows (BA is budget authority, the amount Congress 
authorizes the governnieni to .spend in current or future years; O is outlays, the actual spending expected in each 
yeiu-): 

1991 1992 1993 

Defense 

BA $288.9 $291.6 $291.8 

O 297.7 295.7 292.7 

Intornational 

BA 20.1 20.5 21.4 

0 18.6 19.1 19.6 

Domestic 

BA 182.7 191.3 198.3 

O 198.1 210.1 221.7 

I'or li.scal years 1994 to 1995. the new law esiablishes a single pot of money for all discretionary spending. 
The While Hcni.se and Congre.ss will have to decide how to allocate that money between the three spending 
categories. Spending at>ovc that overall limit would trigger a sequester to bring sjx;nding down to that ceiling. Total 
di.stretionary funds for tho.se two years, in billions of dollars, iu-e as follows: 

1994 1995 

BA $510.8 $517.7 

O 534.8 540,8 

Pdy-as-You-Gu Spt-nding 

Under the new law. Congress is required to offset .lie costs of miy new entitlement spending programs and any 
tax rcdiiciion legislation. If Congre.ss creates iin entitlement program or tax Iwnefit that is not "revenue 
neutral-'- not financed by an offsetting tax increase or spending cut— it would then have to adopt a deficit cuthng 
"reconciliation" hill to find tlie needed savings, railing that, a sequester would cut enough from all other 
cntitleinenis (except tho.se. such as social .security, that are aiready exempt from Uie "sequester" under the 1985 
Balanced Budget Act) \o m;ike up the difference. 

Adhering to broad sentiment in Congre.ss, the new law takes th^- .scxial security trust funds out of the deficit 
calculations. As a result, the hinds' growing surpluses will not Ix- used in determining whether the govenuiient has 
met Its annual deficit targets, fhat i.s a victory for those who complained that llie tmst fund surpluses were maskiiu' 
the budget deficit's true size. 

Scqut'stt'r^ 

Unlike tne 1985 law. which called for a sequester in October of each year in which r^ongress failed to meet 
specific deficu targets, the new law creates a schedule under which .sequesters can (Kcur several times a year for 
dj.scretionary programs and once a yciir for entitlements and tax cuts. 

_ '■rj'^ ';!""^',"»- ^"^'<'" ■■^<""R Now l^tycrs of Complc.Hy u. Hu.l>.cl. ' a ap,K-«i.ng m Uwrcncc- J. Umi.s, -New 
Rulesoflhc(.:iinc."MiH,»«j/y„i,/-;i„/. vol 2?.No 46, Nov IV. I'M), p 279f) 



Continued on next page 
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Box 3-B~New Layers of Complexity for the Federal Budget— Continued 

First, a sequester directed at budget-busting appropriations bills can be triggered, if required, within 15 days 
of the end of a session of Congress. Second, a sequester can occur within IS days of the enactment of such 
appropriations bills if the enactment takes place before July 1 . Third, if those appropriations bills are enacted after 
July 1, a sequester would be applied to spending bills for the next fiscal year, which begins on October 1 . 

For entitlements and tax cuts, the law calls for a one-time review of all bills to determine whether tliey will, 
in total, increase the deficit. If they will, nonexempt entitlements would be sequestered at the same time as the 
end-of-session appropriations. 

Deficit Targets 

The new law sets deficit targets for the next 5 fiscal years. They are (in billions of dollars): 

1991 $327 

1992 317 

1993 236 

1994 102 

1995 83 

For fiscal years 1991 to 1993, the targets are not binding on the White House and C<»igress. Along with the 
spending caps for defense, international aid, and domestic programs, they will be adjusted to account for changes 
in economic and technical assumptions. For fiscal years 1994 to 1995, the President may adjust the deficit targets, 
if he chooses, for economic or technical reasons. If he does not adjust them, failure to reach those targets will trigger 
a sequester like that required under the 1985 budget law. 

Scorekeeping 

furthering a trend that began when the Balanced Budget Act was revised in 1987, the Office of Management 
and Budget (0MB) has been given additional authority to tabulate the cost of tax and spending legislation. 
Previously, 0MB had the power to decide whether, based on the costs of all such legislation and other factors, a 
sequester was required. But the Ccmgressional Budget Office and Congress's Joint Contmittee on Taxation had the 
duty of tallying the costs of each fax and spending bill as it moved throu^ Congress. Now, OMB *s cost calculations 
will be binding on Congress. 



While the Science Advisor and numerous advi- 
sory conunillees allow . icienlific community. t>r 
move accurately, the various resciuch constituencies 
within it. a voice in government decisions, otlicr 
channels also exist to influence Federal jxdicy. An 
unrivaled soujce of authority is the independent, 
congressionally chartered (in 1K63) National Acad- 
emy of Sciences (NAS). The presidents of NAS. the 
Natunia! Aca<ieiny of Engineering, and the institute 
of Medicine act as opnuon leaders and buffers 
between the science community mul tlie {^edera! 
(iovenimcnt (discussed further in chapter .S). H(>th 
ihc executive branch agencies and Congress call on 
(and pay for) NAS lu conduct studies on issues of 
some urgency and importance m science, lecfmol- 
ogy, and medicine.*^ ^ The academies* elected mem- 



bership of eminent specialists, working through 
panels and commissions* lends credibility to the 
reports they issue. 

Vicious intei'est groups have also traditionally 
played major roles in the formulation of Federal 
research funding mui regulatory policy. Of an 
estimated 6jK)() public and special interest groups 
active in W.i.shington, many have a stake in some 
aspect of the diffuse f'ederal research activities. 
Prominent interest groups that lobby on Ix'half of 
science include many industrial groups, professional 
societies, the higher education assocuUions, and 
other more specialized groups that encourage re- 
search m tiu'geted iueas, such as the environment or 
health. 



• And the LDMgrossiorwI uppchle has gr<)wn from 9 Nalional Ac,idcrn\ r< jv^rls inujidalcd h\ \\k ^"^tli (*oM^r<:ss ( l<>79 lo 1980) to 24 by \hc lOlsi Sec 
"C oiiyjvv. Munnry for NAS Advice." .SV/rm r. vol :5(). Ooe 7. HM). p 1 U4 

•^i'lM A detmitivf UK}k M the Naluvud At iuk-my of Sciemes ;(s j s<>cia) iiiNl}lu(i(>ri. see Pliillip Boffey. I he Brain Hufik nf AmtTUxX (New York. NY 
Mv<ir.jvk Utii IMVS) rhe N;uioo:U Aiadeni) J^ress .ilso puhlwhes ;i (|\ianefly lounutl. m Si ictu r .V //•• >i/)/;//»>f v. whu ri provides ;t jM>licy torum 

iiit .in iufiiy ot opuvion leader^ iit ,uid (^ui oi go\crnnR*iit "Ihe N.iUoriai Rese.iah Count iTs (NKC's) \'t'\%\fUpon alst) provjtles a raord of NHlioiial 



Academy of Sciences' studies utuiertalten by NRC* 

-"'helxu.ih M HiiioK ill (eds i. t fu \iltfpt\iui tjf A\mh tuii'' 



' ol : (fkMroil. Ml dale kesearth. Inc . 1989) 




6 



BEST GCrV 



chapter 3---The Federal Research System: The Executive and Legislative Branches • 81 



As discussed below, interest group lobbying is 
most often associated with the legislative branch 
since the congressional decisionmaking process is 
more open and decentralized. However, lobbying of 
executive agencies also occurs and can sometimes 
have a significant effect on specific research pro- 
grams. For example, program managers at the 
Agricultural Research Service in the U.S. Depart- 
ment of Agriculture (USDA) and at the Conserva- 
tion and Renewables Office in the U.S. Department 
of Energy (DOE) state that agribusiness and energy 
industry lobbies, respectively, play a large role in 
setting agency priorities. In the current system, this 
involvement is important, because agribusiness and 
the energy industries are considered the eventual 
clients of these programs. Interest groups can also 
provide additional technical infomiation (which 
may not be available to agency personnel) that can 
be used for decisionmaking, and they can influence 
the development of debate on specific programs. 
Outside interest groups can be seen as an informal 
extension of the advisory committee system and can 
be very beneficial to agency operations. However, in 
a more ideal system, the influence of interest groups 
and their interactions with the government would be 
made more public. 

After the executive branch agencies, OMB, and 
others produce the President's budget, it goes to 
Congress. Research program budgets and their 
accompanying support documentation are subse- 
quently reinterpreted by congressional committees 
to determine agency priorities (e.g., increases over 
inflation or predicted spending targets in specific 
programs are interpreted as strong executive branch 
support, while corresponding decreases are inter- 
preted more negatively). Congress then has an 
opportunity to comment on and change these prior- 
ities. 

The Legislative Branch 

Congress has traditionally been yciy supportive 
of the research enterprise in the United Slates, and 
rarely do debates over research issues divide along 



partisan lines. In particular, there has existed over at 
least the last 30 years a broadly shared supportive 
ideology covering goals, values, programmatic pri- 
orities, and rationales. The same arguments about 
health, economic competitiveness, and national 
prestige are part of members' arguments about 
science policy from all ideological perspectives.^^ 
Nevertheless, emphases given to specific programs 
have varied over the years. 

During the 1960s, research was perceived as a 
means of increasing national prestige, enhancing 
security, and providing benefits. The goals of 
outdistancing the Soviets and maintaining a leader- 
ship position in the world through research were 
supported by Democrats and Republicans, liberals 
and conservatives, hawks and doves. However, 
while some members were convinced that research 
monies for defense could be better spent on domestic 
problems, others believed that direct expenditures 
on defense research would be more effective for 
boosting the economy and national defense. 

During the late 1960s and early 1970s, science 
was burdened with greater material expectations, 
especially after the success of the Apollo Moon 
program. ^2 Preservation of national preeminence 
remained a strong goal on all fronts, but different 
groups stressed different tangible rewards. The 
Democratic party platform in 1972 argued that 
research should protect the environment and im- 
prove employment for scientists.^^ In the same year, 
Republicans sought a science that would improve 
U.S. economic competitiveness internationally.^ 
Liberals and conservatives clashed over the pace and 
extent of environmental initiatives. However, these 
disagreements were most often expressed over 
specific programming rather than the importance of 
a clean environment. 

During the mid- to late 1970s, Democratic and 
Republican priorities divergexi, despite agreement 
on some specific program areas. For example, 1976 
Democrat and Republican party platforms supported 
energy research. However, the Democrats made a 
case for government investment, calling for . . major 



^Scc the Byrd Aiili-Lobbying Provision (Public Law 101-121). 
^^DirdscU and Simons, op. cit.. footnote 7. 

'^Scc J.W. FuJbright. ' 'Is the Project ApoUo Prognmi Jo Uml Astronauts on the Moon by 1970a Sound National Objective?* ' Congressiofuii Digest, 
vol. 44, Fcbniary 1965. pp. 47. 49. 51. 53; and Bwry M. Goldwatcr. "Is the Project Apollo Program lb l^d Astronauts on tlie Moon by 1970 a Sound 
National Objective?** Congressional Digest, vol. 44 ^nbru^ry 1965, pp 53. ^3. 

^^Bnjcc D. Johcson, National Party Platforms . - //. 1960-76 AJrbana, IL: University of Illinois Press. 1978), pp. 802*803. 
^Ibid.. pp K76-877. 
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Photo cr&dii: MichM9i Jenkins 



Two members of the Senate Committee on Energy and 
Natural Resources, wtilch has Jurisdiction over the 
research programs at the Department of Energy and 
Interior, confer. 

initiatives, including major governmental participa- 
tion in early high-risk development projects. . . ."^^ 
The 1976 Republican party platform detailed the 
importance of maintaining a balance among private, 
university, and government efforts at scientific 
research. It pledged to ''...support a national 
science policy that will foster the public-private 
parmership to insure that we maintain our leadership 
role."^ This position in the Republican platform 
was deepened considera! \y in 0MB 's Issues *78, 
which accompanied President Ford's final budget.^ 
Issues '78 stressed the importance of leaving a role 
for the private sector and avoiding government 
involvement in readying technologies for commer- 
cial development. 

During the 1980s, Republicans took the ''Issues" 
agenda a step further, arguing that "partnerships" 
among government, universities, and industry were 
the best way to promote research, leaving all 
development issues to industry except in cases of a 
pressing defense interest. Democrats contested this 
rationale, arguing that a massive increase in the 
research funds oriented toward defense tarnished 
relations between the government and the scientific 
community, 



In general. Congress is empowered to be an 
architect of the research system. Tb implement or 
guide initiatives in the U.S. research system. Con- 
gress can adjust the research budget, craft legisla- 
tion, or monitor and influence Federal agencies 
through the oversight fimction. (See appendix A for 
a summary of major legislation passed by Congress 
since 1975 affecting U.S. R&D.) Unfortunately, 
because it must consider the priorities set by the 
Federal agencies after they have been codified in the 
President's budget or (tfter they have been acted on 
in a program. Congress' position has often been 
reactive rather than proactive. 

The following describes the congressional com- 
mittee structure, budget process, and the oversight 
function. These processes arc well understood. The 
relatively new phenomenon of earmarking appro- 
priations to universities (for eventual use in the 
conduct of research) is described in more detail. 

The Congressional Comnnittee Structure and 
the Budget Process 

Almost one-half of the 303 committees and 
subcommittees of the 101st Congress claimed juris* 
diction over some aspect of research. While 
inhibiting development of coordinated public pol- 
icy, this fragmentation has characterized the long 
history of Federal involvement in research. Further- 
more, congressional history shows that Congress has 
generally chosen to decentrallz;^ decisionmaking 
further rather than to consolidate and coordinate the 
Federal legislative process. 



The Committee System 

Congress* internal party organizations in each 
house assign members to committees, considering 
their preferences, party needs, and the geographical 



^Mbld.. p. 934. 
^Ibid.. p. 984 

^'Office of Management and Budget, Issues '78 (WashUigton. V>C U.S. Government Printing Office, January 1977). 

^'Thc DeuKKrats have always been proponents of more active Federal intervention in R^D that affects the civilian economy. This can be traced to 
llic Kilgore V. Bush debate of the late 1940s over the role of a naiionr.! scir nrc foundation. »^rook5. op. ct»... footnote 9. 

^''MiK:h ol the following sccnou ^y. b^vscd on U S Congress. Ofll:« of fUluiology Assessmeal, Delivehnff the Goo s: Public Works TechnoloKies 
and Managemem, OTA SET-477 (Wajluri^ton, DC: U.S. Govcnunent i^dntiMg Office, April 1991). Also see Morris P. Fiorinii Congress: Keystone 
of the Washington Establishment, 2d cd. ^cw Haven, CT: Yale Univcislly Press. 1989). 
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Table 3-1 -Congressional Authorization Commlttess and Appropriations 
Subcommlttaos With Signiffcant Lagislativa Authority Over R&D 

Jurisdictions of authorization committees; * Agency 
Hou^b: ' 



Agriculture USDA 

Armed Services , OOD Q^g 

Energy Commeroe .'i! i." I.'." ! DOE,' ADAMHA. NIH, CDC, DOT 

Interior and Insular Affairs DOI 

p?»S!lf5^?f ^^^^ Technology .* ! 1 1 ! .* 1 ! .* .* ! ! ! *. ! ! ! ! ! NASA, NSF, DOE. EPA, NOAA, DOT, NIST, DOI 

Public Wortte and Transportation NOAA, DOT 

Merchant Marine and Fisheries USDA NOAA DOT 

Veterans Affairs VA ' 

Foreign Affair .i A.l. D. 

Senate: 

Agriculture, Nutrition, arxi Forestry USDA 

Armed Services ...!!!!. DOD, DOE 

Comnrierce, Science, and Transportation '...V.' NSF.NASA, DOT NOAA. NIST 

Energy and Natural Resources oOB DOI 

Labor and Human Resources n,h, adaMHA, GDC, NSF 

Environment and Public Wbrks EPA 

Veterans Affairs VA 

Foreign Relations V////////. . .......... ... A.I.D. 

Jurisdictions of appropriations committees: * Agency 

Labor. Health and Human Services. Education ~ 

ui fn ■ • NIH, ADAMHA. CDC 

£nJ?«! !!l!Ff^^^^ NASA, NSF, EPA. VA 

Energy and Water Development , OOE 

Interior and Related Agencies [)0e uSDA DOI 

Agriculture. Rural Devdopment, and Related Agendes** , . . USDA 

Commerca. Justice State, the Judiciary, and Related Agencies NOAA NIST 

Transportation and Related Agencies noT * 

Foreign Operations a 1 q 

pg>Q"se pop 

fSt^u^^^^'^l'r^^ f^"f*' '"^rilrl*' ^'^'^^ Adr.ilnIitr.tlon: AID.-Ag.ncy for tnt«rr»tlonal Dev0topm#nt: CDCCenteri for Dl«#«s« Control- 

p^J?"/':^"^. 1 ntpart^nl of Entrgy: DOI.U.S. D#partmint of th« Inttrlor; DOT-U.S. 0^iir\m^\oiT^^ 

EPA-U.S. Env1ronm«ntai Proltction Ag«ncy; HUD-U.S. D#par!m^r4 of Houtlno ar>d Urijan Oavalooman • NASA-Nattona W^S^ 
^^"''"l^'^i^^ri.^^^.^'l'^"' InatltutM of Haalth: NIST-Naltonal .n.tltuta of^tartS a^l^S^ 

Atmospharic Administration; NSF-Natlonal Sdarca Foundation; USDA-U.S. Daparlm^nt of Aorteultura- ^.U fi r^rtZ^^ «n^^ ! 

»»Th» corr«spopdinfl suboommiltsM of th« S«nata and Houm CommitfaM o;-, Appropriations hava tho »ama nam* with ona airccation- ih. lUn.i. 
Subco^mi,,.. on Aflrtcultura. Rural D.v.lopn.nt. and R.lat^l Ag-noia. and th.^..'. SubccmSai'on HuTal 3^1nTAgSu'r^^^ R^fJd 

SOURCES: Wloe^jTjchr^ja^^^^ 



and ideological balance of each committ ee. Most 
bills are referred to one standing commit'.ee, but the 
complexity of public policy issues mean.*, that major 
bills are often sent to multiole committees with 
overlapping jurisdictions. Ir.dividual committee 
mles deterriune a bill's subcommittee assignments, 
which also can overlap. Table 3-1 shows the 



committees with important legislative jurisdiction 
over research. 

Ov apping committee jurisdictions can sK;w 
and even stall policy development and send mir,-^ 
signals to the executive branch and lower levels of 
govermrient. Committees that try to develop com- 
prehensive research policies are often frustrated by 



J"In the IO!il Cor.gress, ih« Senate had 16 standing conimiiieM and 87 subcommittees; the House operated with 22 committees and 146 
ubr^-mnitte«s.In.ddition,.l,c I Ol.t Congress h« 9 special or select (with 1 1 subcommittee,) and 4 Joint coStt.<MwiU, TsuCZinis^^ 
functions „e prm.arily investigaUve. The average Senste committee had five subcommittees. comp«il to sever m t^ House T^lSTl^ 
except top party 'eadcrs. served on at least one standing committer. Senators served on w least two committee* 
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the vested interests of their sister committees, 
executive branch agencies, and various research 
communities. 

Congressional committees have evolved into 
permanent bodies with authority to propose legisla- 
tion, an independence that has given committees 
almost unassailable influence over legislation in 
their specialized areas. ^' Committee chairmen con- 
sequen»!y wield enormous power *^ They tend to be 
long-lived in their positions, holding them much 
longer than the terms of most presidents or Federal 
agency executives. This longevity allows committee 
chairmen to influence the long-term course of events 
in a particular area and to implement detaile<i 
agendas. However, some committees are better 
positioned on certain issues than others. 

The Budget Process and the Authorization and 
Appropriations Committees 

Authorizing committees in both houses report 
annual or multiyear authorization bills for Federal 
programs under their jurisdiction, thereby setting the 
maximum amount of money an agency may spend 
on a specific program. The exceptions are entitle- 
ment programs, such as social security and M;;di- 
caid, which viperate under permanent authorization 
and are effectively removed from the authorizing 
process. Authorizing ^or legislative) committees and 
subcommittees are influential through their over- 
sight functions when major new legislation is first 
passed, when an agency is created or its program 
substantially modified, and when setting funding 
authorizations to initiate, enhiuice, or terminate a 
program. During the 1980s, deficit reduction laws 
and trends restricting spending, shortcomings in the 
budget process, and new programs greatly expanded 
the roles of the "money" committees — Appropria- 
tions, Budget, and Ways and Means on the House 
side, tmd Appropriations, Budget, and Finance in the 
Senate — at the expense of autliorizing committees. 

After the Presidential budget reaches Congress, 
the Budget committees in the House and Senate 
provide a concurrent resolution that sets an overall 
ceiling luid limits for major spending areas, like 
hcaiai or u-ansportation. Appropriation bills, origi- 




Photo amMi: Mkimtl JtrUn$ 

Members of ihe House Committee on Aflricolture debate the 
1 990 Farm BIH. which affected many research programs at 
the Oepaitment of Agriculture. 

nating within the House Committee on Appro- 
priations and its 13 subcommittees, effectively 
control spending since authorized funds may r^t be 
spent unless they are also appropriated. 

No less than nine subcommittees of Appropria- 
tions have jurisdiction over research. While these 
nine subcommittees will decide what monies are 
appropriated tor research, the initial disttibution of 
funds by the full committee among the subcommit- 
tees can have serious impU^^aticus for research 
funding. For example, the Veterans Affairs, Housing 
and Urban Development, and Independent Agencies 
Appropriations Subcommittee is responsible for the 
budgets of NASA and NSF, or 35 percent of the 
civilian R&D budget. If this subcommittee is for 
some reason "left short," then science funding 
could suffer significantly as it competes with hous- 
ing, veterans' affairs, and other programs. Further- 
more, research budgets will be Irjgely negotiated 
within the new "dome-stic" spending category, 
making decisions all the more difficult. As noted 
earlier, the Budget Reconcihation Act of 1990 
establishes limit., on disc.etionary spending by 
category (a nfw Title VI of the Congressional 
Budget Act of 1974). It also sUles: 

As S(x n as pos.sible after Congress completes 
action on i discretionary spending . . . bill, and after 
consultation with the [House and Senate] budget 



«iJudy Schn -idcr. updated by . arol Hardy. The Connressional Siandtng CommtlttSysten^-^n ,ntroduc:..y Guide (V/MUiuglon. EX': Congrf.-.ioual 
Research Service. Ma/ 1989). p. 2. 

♦JThis power wm ciikuiccd in the "HouNe revolution of 1910." limiting the role of the Speaker by establishing seniority as the nujor criteria for 
dctcrraining committee chairmwuKip and moving up w its ranks. Ibid., p. 3. In battles of information where larger support staffs can deteniune the victor, 
committee cbwrawa have a distinct advantage witli additional corimiittec persoonel. 
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committees, the Congressional Budget Office 
(CBO) is to provide the Office of Management and 
Budget (0MB) witii an estimate of the bill's effect 
on spending and revenues. . . . 0MB is required to 
explain differences between its estimates and those 
ofCBO.« 

Some research agencies fared very well in the 
congressional appropriations process during the 
1980s. For example, even under tight budgetary 
constraints, the National Institutes of Health was 
routinely given more money by the Labor, Health 
and Human Services, Education, and Related Agen- 
cies Subcommittee than the Administration had 
originally proposed.** USDA, and to some exte;it 
DOE, have also consistently received more in actual 
budget authority than allocated in the President's 
budget. Although in theory, policy and oversight is 
reserved for authorizing committees, appropriations 
committees frequently insert legislative provisions 
iind funding for special projects into bills (see the 
discussion below on congressional earmaiking). The 
appropriations committees' control over .spending 
and the tendency to modify authorizing legislation 
creates tensions and intensifies intercomrr«ttee ri- 
vahies, particularly in the House where a smaller 
proportion of members serve on the Committee on 
Appropriations. 

In Congress, jurisdiction or turf can main addi- 
tional staff, publicity, and power, prompting com- 
mittees to .seek broad jurisdictions and resist moves 
to narrow theiri, perpetuating conflicts and overlaps. 
Research is.sues are particularly susceptible to frag- 
mentation juid competition, because they cut a broad 
swath across national life. Hi.storically, each issue 
has developed independently based on difffrent 
goals and objectives, establishing supportive com- 
mi'tec connections and constituencies that are hard 
to alter. Larger jurisdictional areas allow greater 
flexibility in linking issues within comprehensive 



legislation. However, they can also pit unrelated 
issues against each other for attention on a commit- 
tee's agenda. 

External Advice and Scientific Interest Groups 

The congressional process is open and decentral- 
ized and is designed to incorporate public opinion. 
Like the executive branch. Congress solicits advice 
from scientific experts on many issues. This partner- 
ship and the active open involvement of the scien- 
tific community has lent strength to government 
decisionmaking on research. 

In addition to .solicited advice, scientific informa- 
tion is also offered by the thousands of public and 
special interest groups that actively lobby the 
Federal Government. These groups organize the 
opinions of their constituents. They employ techni- 
cal experts to press their cases to Congress, testify- 
ing at hearings, providing privileged information, 
drafting model legislation, publishing and distribut- 
ing reports, and meeting with members and staff. For 
example, in the global climate change debates in 
Congiess, various environmental groups (both for 
and against action on global clLmate change) have 
presented comprehensive technical analyses detail- 
ing the current state of scientific knowledge and the 
most notable gaps. These analyses have influenced 
the allocation of monies for research in these areas. 

The number of interest groups and politically 
active professional organizations increased dramati- 
cally during the 1970s and 1980s. This proliferation 
coincided with an expansion of congressional sub- 
committees, which provided more opportunities for 
lobbying and greater public participation n execu- 
tive agency rulemaking.*' While often t^en as 
detrimental to the process, interest groups can 
fumi.^h valuable information to debates and caii 
present important arguments. Nevertlieless, as witli 
'xecutive branch lobbying, because of the informal 
na.jre of the relationship of interest groups to 



rrumJe H . uT ' ■ ''^'""•f 23. P H12745. A later scclion on "scorekccping" undcRcorci (he p«iint: "Scclion 2.5l(j,)(7) and 252(d) of 
Gri«nm-R.idm«.-Hollings as .mended by (his conference agrcemcn. provides ttui Ihe Office of M«n«gemcm and Budsct inus/nuic irLima.el Z 

Sor6.Noli7"^mp^^^^^^^^^^ 

DC*mS'^Tr'^^*''°" SciciKC. CongrrsswnalA^non on Research and Development in the FY 1991 (Washington. 

A,J!J^„n''*7'i'"^* mT " "^K"'8 f"^""- example. u,e ln<lu,.rial Research InMi.u.c. the PfiannaccuticaJ Manufacturer, 

, Z' Y A ; '° Association of State Universities arKl Land-C^w^J CoS^S tte 

As«K.a,.on of An«nc«« Uruvcrstttes. atul the Federal liaison, for tt>c research univcrsiUc who .•x>,k closely with il^ZlS^^X^^ 
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Congress, interactions can appear unseemly. Every 
issue, including research funding, has a constituency 
and, therefore, special interests 

Congressional Oversight 

Congress has invested the executive branch with 
broad authority over the multitude of Federal 
agencies and programs. However, in 1946, Congress 
officially reaffirmed its responsibility for oversight 
in the Legislative Reorganization Act. In 1970, 
Congress required that House and Senate commit- 
tees publish oversight reports every 2 years, and 
increased committee staff size. Congress further 
acted in the 1974 Congressional Budget and Im- 
poundment Act to strengthen the role of the General 
Accounting Office (GAO— a congressional support 
agency) to acquire fiscal and program-related infor- 
mation.*^ 

In addition, House committee rules adopted in 
1974 stipulated that committees with more than 15 
members (raised to 20 members in 1975) create 
oversight subcommittees or require that legislative 
subcommittees provide oversight. Legislative sub- 
committees can only carry out oversight within their 
jurisdiction, while oversight subcommittees operate 
within the full committee's jurisdiction.*" 

Oversight can be exercised through: 1 ) hearings 
and investigations; 2) the authorization and appro- 
priations processes; 3) GAO audits and investiga- 
tions; 4) other studies by congressional support 



agencies; 5) legislatively mandated periodic report- 
ing from executive branch agencies to Congress; 6) 
the Senate confirmation process of high-level politi- 
cal appointees; 7) casework and constituent ques- 
tions about Federal agencies; 8) creation of special 
task forces; and 9) informal, nonstatutory controls, 
such as informal contacts between agency personnel 
iuid congressional staff. Groups outside of Congress 
and the executive agencies aid these processes by 
providing information to Congress about potential 
and existing problems in the executive agencies. 

Congressional oversight has been important in 
determining the budgets of specific research pro- 
grams and encouraging coordination between the 
research agencies.*' Congressional oversight ad- 
dresses the problems of research management and 
priority setting. Recently, fraud and misconduct by 
scientists in federally sponsored research projects 
have also been a focus of congressional investiga- 
tions.^ Combined with the power of the purse, 
Congress has effective tools to initiate change within 
the Federal research system.'' 

One tool that has been increasingly used by 
Congress in the last decade is academic earmiu^k- 
ing — the provision of funds as line items in the 
budget for specific research facilities and projects. 
Because this practice is seen as circumventing 
normal procedures, it has been a subject of heated 
debate within the scientific cor^imunity and Con- 
gress. 



^Somchmes. the best strategy for serving that interest is disputed among the lobbyists lhcrnselv« All work »«'^"J,|!;f '""^ 
a<lveftisements in the Thf Washington Post and The New York Time,. For ewmple. sec Joseph Pale.. ' •Grants Squeeze Stirs Up Lobbyists. Saenie, 
vol. 248. May 18. 1990, pp. 803-804. 

^'Congressional Quarterly. Congressionai {Juarierlf , Guide to C mgress, Michael D. Wonncr (ed.) (Washington. DC: Congressional Quarterly Inc.. 
1982). pp. 4.'59-462. 

«In 1990 there were 1 1 House conunittecs with oversight subcommittees: Armed Services; Banking. Finance and Urban Affain; Energy and 
Commerce Interior and Insular Affairs; Merchant Marine and Fisheries; Post Office and Civil Service; Public Works and Transportatiori; Sc encejpaw 
i^rri^ ogy veterans Affairs; Ways and Means; nni Select Intelligence. In addition, there are four committees whasr -^Pl'^ /'^"""Jf /o 
Appropriations Budget. District of Columbia, and Oovermnent Operations. The House rules elso give «vcn ctHnmltteci special i"^"^"" J" 
crS; AlsdiCional liL: Anned Services; Budget; F.ducation «ul Labor; Foreign Affair,; Interior «|d Insular AfWrs; S^»t«f^P»^*"^,^^S 
and Small Business. THree Senate committees hod oversight subcommittees: Agriculture. Nutrition, and Forestry; Fitiancc; and Govemmont Opci«ions^ 
Two Senate committees have implicit over.«ght respoasibU.Ucs: Appropriations uid Budget. Ibgetlwr. the House and Senate committees have oversight 
over all of the R&D programs in the Federal agencies. 

«Sec Morris S. Ogul and Bat A. Rockman. "Overseeing Oversight: New Departures and Old Problems.- ' te^w/awi'e Studies Quarterly, vol. 15, 
February 1990. pp. ."5-24. 

WScc Marilyn J . Littlejohn and Christine M. Matthews, ".Scientific Misconduct Ui Academia: Efforts to Address 'tf '""/^^'^''-^'P''"^':;,^"*^": 
89-392 SPR (Washington. DC: Congressioiul Research Sctvice. June 30. 1989); Rosemary Chalk and Patnoa Woolf. Regulating a Know«>8C 
Business-." Issues in Science A Technology, vol. 5, No. 2. winter 1988-89, pp. 33-37; U.S. Congrew. House Committee ScieiKe. Sp«e.^ 
Tfcchnology. Subconmiittee on I/ive«tig«tions «id Oversight, Maintaining the Integrity of Scientific Research, 101. t Cong^ (WasWngton IM ■ U.y 
Government Piinting Office. J wiuary 1 990); and U .S Congress, Hou.se Committee on Government OperaUons, Me Scientific Misconduct and Conflict* 
of Interest Hazardous to Our Health? 101st Cong. (Washington, DC: V S. Government Printing OfTicc. September 19«K)). 

"For an analyJis, see Marcel C. UFollette. "Congressional Oversight of Science and Ikchnology Programs." paper prepared for the Committee on 
Science, Ifcchnology, and Congress. Can>cglc Conmiission on Science. Ifechnology. and Oovemmeut. New York. NY, September 1990. 
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Congressional Earmarking 

Since the early decades of this century, powerful 
legislators, especially committee chairmen and 
ranking members, have made the congressional 
earmark (a specific project funded directly by 
congressional appropriation) a routine, albeit small, 
part of the process by which the Nation's budget is 
disbursed to regions, States, and districts. Through 
earmarks a range of goods and services are procured. 
The practice of congressional earmarking is now a 
well-entrenched and important component of this 
pohtical system, and u has historically been re- 
garded as a redistributive device that addresses fiscal 
inequities through legislative power.^^ 

While earmarking has been a traditional funding 
mechanism in many areas of government spending, 
explicit "academic earmarks" appear to be a 
relatively new phenomenon, dating to the early 
1980s. 53 That this funding mechanism has been 
extended to academic research is not surprising, 
given the geographical and otiier inequities in 
research funding, However, for the scientific com- 
munity in which the ethic of peer review is so strong, 
earmarking is contrary to the established mentality 
of "fair" funding allocation. It signals a departure 
from the old social contract that delegated authority 
to representatives of the scientific community to 
judge technical merit and advise the Federal Govern- 
ment on research investments.'^ 

What Is an Academic Earmark? 

For the purposes of this discussion, OTA defines 
a congressional academic earmark as a project, 



facility, instrument, or other academic or research- 
related expense that is directly funded by Congress, 
which has not been subjected to peer review and will 
not be competitively awarded.^' Among the largest 
examples of 1990 earmarks under this defmition are 
the Soybean Laboratory at the University of Illinois- 
Urbana, the Waste Management Center at the 
University of New Orleans, a medical facility at the 
Oregon Health Sciences University, and a geology 
research project awarded to the University of Ne- 
vada system. 

There are other definitions of academic ear- 
marks.56 One states that an earmark is any research 
project or facility directly funded by Congress. This 
definition implies that the executive branch role in 
setting budgets and priorities and administering the 
Federal Government's research programs is more 
valid than decisions made by Congress. Not surpris- 
ingly, some members consider this definition an 
insult to Congress. Another definition stresses that 
earmarks are projects that are initiated by Congress 
and receive appropriations, but not approved by 
authorizing committees. This defiintion reflects 
some members' view that the legislative process 
should work as is formally intended, i.e., authoriza- 
tions should always precede appropriations. Conse- 
quently, this definition i.s sometimes used within 
Congress to oppose earmarking, as earmarkers 
violate die norms of the budget process. '' Still other 
definitions seek to make exceptions for direct 
appropriations for projects in the Agriculture appro- 
priations bill, because agricultural research is said to 
have a distinct culture where such projects are the 
norm. Finally, other defmitions make a distinction 



"John A Ferejolm, Pork Barrel Politics (Stanford. CA: Stanford University Press. 1 974). p. 252. One story has it tlu>t the word ' 'eanraik* " derives 
from a practice " old as the Republic iuelf. Pigs' ears were cut off prior to the animus grazing in a common area with the pigs owned by oUiers. Credit 
for a stolen or slaughtered pig could be estabUshed by possession of the physical evidence— the "mark" " of the ear. 

«Hugh Loweth. who retired after 35 years from the Offlce of Management and Budget (OMB) in 1986 as deputy associate director for energy and 
science, cites as the origin of the current wave of academic earmarks Science Advisor George Keyworth. In 1982. without consulting either with OMD 
^M^JiZ ""J'^S ^°'°»'«^'y- Keywoth «"e'np««« to Insert $140 million in the Department of Energy budget as » "Presidential imtiative' " for 
a National Cer-er for Advanced Materials at Uwrence Berkeley Uboratory in California. A storm of protest led. depending on the soi^rcr. to a scaling 
hwk of the project or • Jempowy deferral by Congress. See Wil Lepkowskl. -Hugh Lowcth. Key Science Policy Official. Retires. " Chfnncol 2 

^X'J^^J \\ ^i"! ^ ""'^P'^' ^ sigliificance of this event this way: ' ■Aftc that episode Congiwslost U« rcsUain; widi 

v^fSi / ^"K, «f ^^'«<'8«'- 'f Presidential Initiatives were possible, it was argued, so were congressional iniUaii vcs. 

and uiuvcrsmcs began to lobby Congress directly for them. 

M«!!h%??S^/.^n^r^ n*f ^'"^J^ Blanpied (eds.). Science. Technology, a,uiGovernmeni. A Crisis of Purpose, proceedings of a symposium. 
Marchl98Ka-*Jolla.CA:Univenity of California. San Diego. 1989). pp. 53^1. 

"In this contex t, peer review refers to the competition of proposals for funds, which are rated by independent scientific experts selected to advise an 
agency. See cb. 4 for a more conip, . ic defmition of peer review, 

"^y"'!?* °" ""'^"^''y °' Virginia. ••Academic liarmarks and the Distribution of Federal Research Fu.«ls- A Policy 

uiierpreiauon. ota contractor report. July 1990. Available through the National Tfechnical Information Service . see app. F 

Mn!S"^h!" ' °w ^ ?^ ?" "^"^"S^ ""wy congressional represenutives earmark. oUiers are steadfastly opposed to it. See Dan 

Morgan. Nunn Says He'll Investigate Some Defen* BiU Projects." The Washington Post. Oct. 10. 1990. p. A4, 
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between earmarks and direct appropriations for 
historically Black colleges and for other tradition- 
ally federally funded institutions such as Gallaudet 
University in Washington^ DC. 

The Debate Over Congressional 
Earmarking for Research 

Within much of the scientific community, aca- 
demic research earmarking is disdained: it is seen as 
circumventing peer review, politicizing science, and 
reducing the quality of research by diverting funds 
that otherwise would be awarded competitively for 
facilities and projects.^^ However, no one claims that 
simply because a project was funded through 
earmarking that ipso facto it would produce bad 
science. There is in fact evidence that earmarks can 
produce well-rcspccted research;^^ some universi- 
ties have defended their earmarks by pointing to 
positive evaluations of the earmarked projects by the 
relevant Federal agency (after the project has been 
initiated). Opponents to earmarking state that, given 
limited Federal resources, many worthy projects are 
likely to be denied funding, and thus some means of 
evaluating and ranking all research proposals are 
desirable. Some appropriations subcommittees may 
seek the advice of the cognizant agency on the merits 
of an earmark before funding it, particularly on 
facilities projects, but there is no evidence that such 
advice is sought systematically. 

Earmarks often originate with legislation pro- 
posed by powerful members of Congress and 
strategically placed members on specific commit- 
tees. There is much benefit to obtaining an earmark, 
especially since such projects are a relatively inex- 
pensive way to help ensure reelection by bringing 
Federal funds to the member's district. These 
members are thought to be able to stifle debate on the 
merits of these projects, or cooperation between 



members is thought to circumvent it. This lack of 
open debate is seen as potentially jeopardizing the 
quality of the projects funded by earmarks and 
contributes to the perceived waste of national 



resources.^ 

On the other hand, many support earmarking, 
claiming it as legitimate political decisionmaking 
without which fair distribution of Federal funds 
would never take place. Proponents contend that 
there must be a tradeoff between efficiency and 
distribution, and that policymakers must work so 
that a portion of the wealth can be distributed to poor 
areas of the country .^^ 

Congressional earmarking must also be viewed in 
relation to the almost absolute power of executive 
agencies to disburse Federal monies (subject to 
oversight by Congress). By seeking support for a 
s(>ecific program or project, executive agencies can 
designate monies for specific geographical areas or 
institutions — much like an earmark. For example, 
the SSC is to be built in Ibxas. DOE is thus supporting 
research in a specific geographical area and in the 
institutions and groups that will participate in the 
aeation of the SSC.^^ Congress wonders whether it 
is responsible democratic government to confine all 
direct spending power in the executive branch. If 
agency processes do not meet desired ends, many 
claim that there must be some method tor Congress 
to directly correct inequities. Earmarks thus are seen 
by many — both inside Congress and out — as ex- 
penditures having merit in furthering socially justifi- 
able goals. 

As congressional earmarking is cunently prac- 
ticed, it can disrupt agency budgeting. If additional 
money is not set aside for earmarks, then funds that 
were planned by the agency for their new or 



'•These trgumenta arc reviewed in Dtryl E. Cbubin, ' 'Scientific Malpractice and the Contemporary Politico of Knowledge/* Theories of Science in 
Society,f%.U, Cozzcns and TF. Gieryn (edi.) (Bloomingtoa, IN: Indiana Univer*i!> Preis, 1990). pp. 149-167. AJ«o see Ken Schlossbcrg. '•Earmarking 
by Congress Can Help Rebuild the Countiy's Resejm;h Infraatruciure/' The Chronicle of Higher Education, vol. 36, No. 19, Jan. 24. 1990. p. A48: and 
Bob Davis, ••Federal Budget Pinch May Cut Amount of 'Pork* to Colleges Living Off of the Fat of the Land.'* The Wall Street Journal May 2. 1590. 
p.A18. ' 

^OTA interviews in the spring of ! 990 at the Departn^ont of Eueigy (DOE) found that many eannarks of the early 1980s produced rc,scan h centers 
highly regarded by some DOE program managers who tud originally opposed them. 

^U.S. General Accounting Office. Budget issues: Earmarking in the Federal Goytrnment (Washington. DC: January 1990). p. 1. 

*'Earmarkmg can be m conflict with peer rcvicv/, and perhaps should bt, llie two processes are designed to acWcve different goals. 

62phil Kunlz. "Pic in the Sky; Big Science ii Ready for Blastoff.'' Congressional Quarterly Weekly Report, 'oV 48, Apr. 28, 1990, p. 1254. 
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continuing programs must be reallocated to cover 
the congressionally mandated expenditures.^'" For 
example, to cover earmarked projects in fiscal year 
1989, DOE'S Office of Basic Energy Sciences 
reallocated $20 million from programs it had 
planned.** lb the extent that this is undesirable, it 
could be remedied if Congress would increase 
appropriations to cover the expense of earmarked 
programs or facilities. In addition, an earmark 
includes permission for the agency to spend less in 
another area (e.g., when Congress designates money 
for equipment at a specific university while also 
appropriating monies for programs that disburse 
ftinds to universities for the same type of equip- 
ment), and this tradeoff could be made explicitly in 
the congressional budget. 

There are few sources of academic earmarking 
information, and longitudinal data are even harder to 
compile.*^ Table 3-2 shows that for fiscal years 1980 
to 1989 over 300 earmarks in appropriations bills for 
academic facilities and projects represented a total 
dollar value exceeding $900 million. In the fiscal 
year 1991 budget, at least $270 million was desig- 
nated for earmarks.** The data focus on appropria- 
tions, reflecting the fact that most earmarks originate 
in appropriations rather than authorization bills. 
Eventually the focu.s of data collection and analysis 
will have to expand, however, because academic 



eannarks have appeared in authorizing legislation, 
and some are added in amendments to legislation on 
the House and Senate floors. 

Academic Earmarks: Increasing Research 
Capacity and Equity? 

Two issues have been linked to earmarking. The 
first is that the Federal Government has decreased its 
funding for facilities since the 1960s. Because many 
earmarks are specified for facilities construction, 
some argue that a Federal facilities program would 
decrease the frequency of earmarking in Congress.*^ 
However, since the potential demand for new 
facilities is so large, no Federal facilities program 
could immediately address all of the need, and 
earmarking would still be important to allow some 
institutions to receive facilities monies in advance of 
others. A similar argument holds for the earmarking 
of equipment. 

The second issue addresses the most commonly 
stated reason for pursuing earmarked funds — that 
existing proposal review systems are biased in favor 
of certain institutions over others for the distribution 
of Federal funds. Academic institutions that are not 
research intensive (the so-called have-nots) seek 
earmarks to acquire the scientific infrastructure that 
gives research universities (the so-called haves) a 
competitive edge in winning research awards. Ear- 
marking thus is seen as a means of reducing inequities 



■ ^ of Science aixlTkchnology Policy identified over $800 million in congressional earmarks for R&D projects in the fiscal year 1 991 budset 
Overone-third of the« came from «xou^^ 

from other projects." See Colin Norman, "Science Budget: Growth Amid Red Ink." Science, vol. 231, Feb. 8. 1991, pp.^^rs' quStefr^m 6^7 
Corey S. Powell. "Universities Reachlnio Pork Barrel With Help From Friends In Congress." Physics Today, vol. 42. No. 4. April 1989. pp. 43-45 
"Sources include systematic listings in The Chronicle of Higher Education of insUtuUons receiving eannarks. occasional itorie« in Science <£ 

Ofnce (OAO)sn»dy of 17 Department of r^^^^ .. either congressionally mandated or esUbUshed by the Army . . ." included fo^tecu 

that were estabUshed non-compctiUvely." However, the foc is of the OAO report i, oversight of univers^ research ukI is wt^a Mm^hS 
/XZr«l'?1''?'/rr"'", " P^"' tatematloSi Security Z In.ern.Uon3 SoMsiiTi^^"^^ 

"iZZT, Z ^1!'f"'^ OAO/NSIAD.90.223FS (Washington. DC: August 1990). THe most cSm^EiveTu on 

on Su^B^cn "^Z^ ^l' t**^""^ '"^ ^ Off"'" °f ^ University of California.^ «^Tpw 

Tu VZo^ l"' "Appropriations Enacted for Specific CoUcges and UnlversiHes by the 96lh nirough the 100th Comtmi " CRS Rewrt EPW 
Feb. 6. l989.SeeJ^e,S«v»gc.Ofnceof the President. UniversityofCallfora^ 

^Elioi Marshall ami David P. Hamilton. '*A Glut of Academic PorfSc/enre vol 230 Nov 23 logn nn \(Y7'> imi A^iw *; a r 

«'For more on the issue of research facUities. originated through earmarks or not, see Congressional Rewarch Service Bricks and Mort^r a Vum^r. 
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Table 3-2— Apparent Academic Earmarks: 
Fiscal Years 1980«89 



Rscal year Dollar value Number 



19B0 $ 10.740.000 7 

1981 — ■ — 

1982 9,370,999 9 

1983 77.400.000 13 

1984 39.320.000 6 

1985 104.085.000 36 

1986 115.885,000 39 

1987 113.800.000 41 

1988 232.292.000 72 

1989 202.537.000 87 

1990 132,381.087 94 

Total $1,037,811,086 407 



^heoniy direct appropriations In 1981 weratohistoricaily Black universl- 
tlasOhraa) and two otharinstltutloni within thaD}strk:to4 Columbia, which 
Savaga do«s not count aa acadamic aarnnarHa. 
SOURCE: Jamaa Savaga, Off ica of tha Prasldant. Unlvarslty of California. 
"Apparent Academic Earmarks In tha Fiscal Year 1 990 Fadera! 
Appropriations Bills;' mimao» December 1989. table 1. 

or leveling the playing field.^ (See table 3-3 for a 
10-ycar breakdown of earmarking by appropriations 
subcommittee.) 



Congress is concerned with equity in all of the 
funds that it disburses. The historical concern within 
Congress over equity in science funding has cen- 
tered on geogrnphical equity, not the contemporary 
emphasis on institutional development. Geographi- 
cal distribution suggests that certain institutions 
from each major region should be competitive in 
receiving Federal funding. In this manner, each 
region would have some opportunity to develop 
centers of excellence.^^ Institutional equity refers to 
the ability of each institution to be able to rise to 
prominence through Federal research funding. How- 
ever, since there are 3.400 colleges and universities 
in the United States (1.300 that award science luui 
engineering degrees, and 100 institutions that al- 
ready commiuid the largest share of Federal re- 
sources and produce most new Ph.D. researchers), 
the Federal Government faces a daunting task.^^ 



The present situation is this: much like the 
stratified distribution of competitively awarded 
Federal research funds, academic earmarking over 
the last decade has primarily benefited a handful of 
States and academic institutions, although the total 
amount of earmarked dollars has been relatively 
small. Table 3-4 ranks the recipients of earmarked 
ftinds by States for fiscal years 1980 to 1989. More 
than 40 percent of these fionds went to just 5 States, 
while two-thirds were awarded to only 10. The 
bottom 10 States received less than 10 percent of the 
earmarks. 

... 3 of the top 10 earmarkers include Massachu- 
setts, New York, and Illinois, which rank in the 
National Science Foundation's list of top 10 State 

recipients of Federal research funds NSF's top 

10 research States received more than a third of all 
caraiarks.^^ 

This same pattern of concentration is evident at the 
institutional level: 10 universities received nearly 40 
percent of the earmarks during the last decade. (For 
the full distributions by State and by institution, see 
figure 3-2. For a ranking of institutions by Federal 
R&D funds awarded, see appendix B ) 

A question for analysis might be: How have 
earmarked funds affected the research capability of 
the institutions receiving them? Between fiscal years 
1980 and 1989, 20 academic institutions each 
received roughly $14 million in earmarked funds, or 
collectively 60 percent of the total earmarked 
dollars. But to determine the relationship between 
earmarking and research capability, otiier questions 
need to be addressed empirically: How have institu- 
tions used their earmarked funds? And if an institu- 
tion improves its research capabilities and perform- 
ance « as indicated by a change in its nuiking of 
Federal research funds received or by its publication 
and citation output, is this due to the earmarks it 
receives? Or could it be that a university adniinis- 



'^Scc William C. Docsnian aitd Christine Matihcw.s Rose, "Equiiy, Excclleocc. ami the Distribution of Federal Resetrch and Development Funds/' 
CHS Report far Conj^rfxs (Washington, DC: Congressional Research Service, Apr. 25, 19H9). But evidence shows that even research- intensive 
institutions pursue earmarks. 

^For evaluation of an early NatioTjal ScictKc Foundation program dedicated to this proposition, see David E. Drew, Science Development: An 
Evaluation Snuly. technical report presented to the National Board on Graduate Education (Washington, DC: National Academy of Sciences. June 1975). 

^'Science and engineering research requires a huge capital investment in facilities and instrumentation, followed by sustained operating support of 
that infrxstructure. to attract and retain cutting-e<ige researchers. This capability in turn breeds success in the competition for Federal research funds. 
Sec Norman M. Bradbum. "llie Raiiking of Universities in the United States and Its Effect on Iheir Achievement/' Minerva, vol. 26. No. 1, spring 
i9H8, pp. 91 -1(X). In ilscal year 1 9K9. 1 00 iasiitutioas received 85 percent of Federal academic Ri&D fuiids. See National Science Foundation, Selected 
Data onAcademicSciencelEngineering RAD Expenditures: FY I9H9, NSF90-:i21 (Washington, DC: October 1990). and CASPAR database, table B-35. 

^^A list of 74 universities and colleges receiving more than $1 million in carnmrlced funds in fiscal years 1980 to 1989 can also be fouinl in Savage, 
•'llic Disuibution of Academic Haniiarks in tlie Federal Ciovernment's Appropriation Bills," op. cil., footimtc 65. pp. 6-7. 20-22. 



ERIC 



w 

M 
00 

m 

a 
I 



ERIC 



Table 3.3~Apparent Academic Earmarks, by Appropriations Subcommittee; Fiscal Years 1980-90 ((numb,r o i project.) dollar,, m million.) 

iiii'^i:;: i^pi z .^^^ = = = = 

I ::::::::: 41o1;? oe^sJ:? '^':t %! = ~ - 

i ::::::::: !?2iJL^ gjg:? = ^^'^^ '^'^ 

1988 72)232.3 (28)128.3 (28 49 2 2 28 S in^i'l ^' ,.,."7 ~ " (3)06 

IJS (87) 202.5 Si) 73.9 (^49 51.9 a '?! (1 9 9 (2) 4I (i ^^ l ^'^ (3)5.6 

S:jento,-<'''''^'°''' (^^)W8.3 (20,$82.1 (17)167.7 (7, $22.4 (7)$19.9 (20,115.3 
100% a^T'^^' 24.2% 13.4% 6.8% 7 5% 6 2% 2 0«^ 

SOURCE: jy™.s.«^^^^^^^ 
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funds 1988 Federal 

niimfirlTrlfim''- ^oumulatlve) research rank ^ 

!5I!!)5!!iI?!*^ — ^iiiiiiooo'" J 

1. Massachusetts 82,901,333 

2. New York 78,150,000 

3. Oregon 62.377,000 'J 

4. Florida 60.819.000 ^^-^^^ 

5. Illinois ^ 30 

56,700.000 03 

6. Louisiana 37,700.000 21 

7. South Carolina 34,423,000 

8. Wsst Virginia 34,400.000 JJ 

9. Alat)ama 30,045.000 62.9 ^ 

10. New Hampshire g 

, , 26,800.000 35 

11. Pennsylvania 25,317,500 

12. Hawaii 24,858.000 

13. Iowa..... 23,426,000 

14. Mississippi 22,575.000 76.5 

15. Arizona 1 

21,740.000 44 

16. California 20,259,333 

17. North Dakota 17.51 5.000 

18. Oklahoma 15.920,000 

1 9. Washington 15,020,000 8o.5 

20. District of Columbia <7 

13,050.000 'g 

21. Indiana 11.700,000 ^ 

22. Texas 11,100,000 

23. Nevada 11,000.000 q 

24. Utah 9,900.000 92.8 

25. North Carolina 32 

9.321.000 21 

26. Kansas 8,810,000 

27. New Jersey 6.100,000 

28. New Mexico 5,700.000 , -7 

29. Ohio 5,304.000 9*>-~ 

30. Kentucky 31 

, , , 5.000.000 3 

31. Rhode Island 4,350,000 A 

32. Maryland 3,750,000 17 

33. Connecticut 3,690,000 

34. Idaho 3,550.000 98.9 

35. Wisconsin g 

3,250.000 yg 

36. Michigan 1,800.000 

37. Minnesota 1.450.000 

38. Vermont 1.200.000 „ 

39. Arkansas 517.000 99.8 

40. Georgia .,8 

450.000 -g 

41. Virginia 315,000 

42. Netxaska 290,000 !q 

43. Alaska 225,000 ^ 

44. Missouri 195.333 99.9 

45. South Dakota 40 

50.000 100.0% 

46. Montana $90 8,429.999 .. — 

TQ*" -• • " "," " Paliiwflf ^-'rffl^ " Wyoming. 
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Figure 3-2-*App«r6nt Acaitomic Earmarks by 
Stata and at Unlvaraitiaa and Collages: 
Fiscal Yaars 198049 

Cumulative distribution of academic 
earmarks, by State: FY 1960-89 
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Number of States 

Cumulative dlntrlbutlon of academic 
earmarks at universities and colleges: FY 1980-69 



1,000 r 



Millions of dollars 




;2i|96%,97% |98% 100%; 
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SOURCE: James Savage. Unlversilyof California, Office of Ihe President, 
'The Difilribu'ion o1 Academic Earmaf^a (n Ihe Federal Qcvern- 
menVa Approprlallons Biiit, Fiscal Years 1960-1089,'* mimeo. 
Mar. 7, 1989, tables 3 and 6. 

tration that seeks earmarks is also engaged in a 
broader campaign to strengthen tlie research mission 
of the institution? 



At present, there are no answers to these ques- 
tions.*^ NeverthelesSt data could be collected and the 
effect of earmarking evaluated over time^^ If the 
results of these studies show that science performed 
in earmarked projects or v^ith earmarked facilities or 
equipment is markedly inferior to other research 
projects supported under other agency programs, 
then steps could be taken to isolate problems 
inherent in earmarked projects. On the other hand, if 
these studies show that earmarked projects have an 
impact on research that is equal to (or even greater 
than) other projects supported through executive 
branch programs, then perhaps some of the concern 
over congressional earmarking is misplaced.^^ 

Conclusions 

This chapter has presented an overview of the 
highest level of decisionmaking for research in the 
Federal Government. Both the executive branch and 
Congress attempt to respond to changing national 
needs and potential research opportimities. How- 
ever, due to their respective political agendas, modes 
of organization, and spheres of responsibility, they 
often disagree about the appropriate Federal role to 
pursue them. 

The President, 0MB, OSTP, Congress, and inter- 
est groups have separate roles in the decisionmaking 
process. They differ primarily in their concerns and 
priorities. For example, OMB is mostly concerned 
with fiscal issues, whereas OSTP is more concerned 
with coordination and comprehensiveness. Thus, 
long-term budgetary planning is very difficult. 

In particular, the '^research budget" is rarely 
considered as a whole in the Federal budget process. 
Separate parts of what might be considered the 
research budget are contained in many different 
budgets. Consequently, issues of concern to many 
parts of the research system are not considered 
across-the-board. **Nowhere in government is the 



^^Institutions that have won eannarked money say iu biggest iinp4ct it on their ability to recruit talented icieotisu. But it may alio help to relieve 
the squeeze on research space, and in general upgrades the technical capabilities of the researchers Involved. Se« Colleen Cordes. **CongreailGnal 
Practice of Eainuurlring Federal Funds for Univcnities Offers Both Promise and Peril.'* The Chronicle of Higher Education, vol. 36. No. 17. Jan. 10. 
1990. pp. A 19. A24. It Is too soon to tell how the quality of research produced at facilities created through earmarked funds couipares with the research 
emanating from eaclusivcly peer-reviewed, project-based academic centers. 

'^Crow. op cit . footnote 65. points out that: "A singieeaituark can provide a university with the opportunit)- . . . for the development of reUuionships 
and pasonal acquaintances that might yield nonearmarked collaboration with that Federal agency in the future. A single earmark might provide the 

opportunity fo develop new and continuing relatioiiships with baiiness and industry or Sute government Thus, while a university's total research 

funding may increase only marginally over a y to lO-year period (less than 5 percent) as a result of an earmark, the earmark might still have had 
substantial impact because of its impact on a specific program (e.g.. a 50-percent inaease in competitive funding over a 5- to IQ-year period), Also 
see 'ilow Iowa Slate Univenity Wins Millions in Earmarked Funds." The Chronicle of Higher Education, vol. 37. No. 24, Feb. 27. 1991. p. A2I. 

^Mlowever. tlie problem of regional inequity will remain regardless of earmarks. This could be addressed by both the executive branch and Congress. 
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Photo credit: MicM Jmidns 



The Senate Committee on Energy and Natural Resources holds a public hearing. 



big picture considered; nowhere is the overall health 
of U.S. science and technology a primary mission or 
responsibility.'*^^ 

An important aggregation of the research budgets 
could occur in the congressional appropriations 



process. Earmarking is also one visible, albeit minor, 
means of congressional budget negotiation. In tlie 
next chapter, OTA introduces the major research 
agencies, their priority setting for research, and 
funding allocation mechanisms. 



''Moroiic. op. cit. footnote 5, p. 12. 
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CHAPTER 4 

The Federal Research System: The Research Agencies 



Introduction 

The effective management of the Federal research 
system depends on the quality of the research 
agencies and their staff. Over the last 30 years, as 
research budgets and the system have grown in size, 
the importance of these agencies in decisionmaking 
has increased. 

Each agency has its own culture, which contrib- 
utes not only to its success, but also embodies 
historically the ''way things are done/* Agency 
culture is thus a powerful determinant of future 
directions, with specific goals reflected in the 
collective knowledge of agency personnel. Plural- 
ism and decentralization characterize each of tlie 
research agencies, with many separate programs 
pursuing diverse objectives. In particular, the lines 
of decisionmaking within an agency are more 
complicated tlian any organizational chart would 
suggest. 

In preparing this report, OTA selected the six 
Federal agencies that fund most of the Nation's 
research V They are, in the order of their fiscal support 
of research (including basic and applied): the 
National Inslitutes of Health (NIH), the U.S. Depart- 
ment of r>efense (DOD), t^ie National Aeronautics 
and Space Administration (NASA), the U.S. Depart- 
ment of Energy (DOE), the National Science Foun- 
dation (NSF), and the U.S. Department of Agricul- 
ture (USDA)^ (see figure 4-1). OTA reviewed 
historical budget figures for these agencies and 
conducted inperson interviews with agency person- 
nel, ranging from top administrators, who interpret 
and set annual research priorities, to program 
managers, who disburse the funds. Ihe interviews, 
125 in all, yielded information on goal setting in the 
agency, proposal review, and methods of allocating 
funds. Interviews with National Academy of Sci- 
ences (NAS) staff (who are commissioned by 
research agencies to perfonn studies that will 
enhimce decisionmiiking) augmented the agency 
descriptions (see box 4- A). 



OTA found that the research agencies generally 
attempt to follow their missionsi as outlined in their 
founding charters and in subsequent legislation. 
However, congressional and executive views di- 
verge cn what is included in missions. There is also 
disagreement at many agencies over what consti- 
tutes a thoughtfult flscally prudent, and expeditious 

Figure 4«1'— Research Obligations in the Major 
Research Agencies: Fiscal Years 1960-90 
(In billions of 1982 dollars) 

Billiona of dollars 
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KEY: DOO « U.S. 0«partm»nt of D4f«mi9: DOE - U.vS. 0«parlm«nt of 
Energy; NASA - N«lk}nal Atronautica and Space Adminlslratlon; 
NIH • National ln»t)lulas of HMith; NSF • Nalianal Sdanca 
Foundation: USDA « U.S. D«parlmanl of A^rtouttura. 
NOTE : Raaaaroh Inchnlaa botn basic and appflad. Bafora 1 969. obllgallons 
for NIM waro nol brokan out in Ihia tourca, Flgurai wara convartad 
tooon«lanl 1 982 dotiara using thaONPImpllcil Prica Daflator. 1990 
figuras ara aitlmatas. 

SOURCE: National Sdwnca Foundation. F^d^rai Funds for R^swch Mnd 
D^vBiopfn^nf, D^taiM h^utorLM Tmbhs: Flacml Vaa/i 1955- 
fPdO (Washington. DC: 1990). labia A; and National Sdanca 
Foundation. S^^^dData on F0d0nU Funds for R^swch and 
D^v0iopni9nt: Rscsil Vaars 1989, 1990 t^nd 1991 (Washington. 
DC: Dacambar 1990). taUas 4 and 5. 



'IbgctiJcr ihcsc agcivcjcs supply rou^^^ily 9!S percent of tlie Federal research bu<igcl. Sec All>crt H. Tbich snd KaOilccn Grmiup. H^SlD in the 1980s: 
A Special Report (Washijigton. DC; American AsAocmiion for ilic AdvaDCcincni of Scicwcc, Sepictnbef 1988). 
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Box 4-A--OTA Interviews at tlie Federal Agencies 

For this itudy , OTA sought dau on the leseaich f oali of the six major Federal sgencies that fiind basic reseaich: 
the U.S. Departmeot of Defense (DOD), the U.S. Department of Eneify (DOE), the Natknal Institutes of Health, 
the National Aeronautics and Space Administntiaa, the National Science Fbondatioo, and the U.S. Deptt^aent of 
Agiicubure. In addition to collecting budget data, OIA performed 125 interviews with afency personnel mging 
ftom top admhiistnitois who interpret annual budget priorities to program nunagen who disburse the funds. 
Interviews at the National Academy of Sciences and the Office of Mkiiagement and Budget augmented the agency 
interviews. 

Discussions centered ca decisionmaking, prioiiQr setting, and funding allocation mechanisms, laical 
questions that were asked included: 

1. What are the stated goals for agency research monies and programs? What goals are not stated, but are 
implicit in the agency's mission? How have these goals changed since the 1960s7 the 19708? the early 
19808? 

2. What processes (both fomud and informal) ars used in the agency to set priorities and goals for research 
monies? How has this process dianged in the last 20 years? 

3. How do new directions in research that are not anticipated get funded? 

4. Does Congress set goals for the money that the agency allocates? Has this changed over time? 
3. How do agency divisions coordinate with otl^er parts of government? 

6. What mechanisms are used to allocate funds? How do these mechanisms dififer for extramural and 
intramural funding? 

To iilusu^e the scope and depth of the interviews at the agencies, the interviews ccmducted at DOE can be used 
as an example. Interviews were conducted in five offices under the Secretaiy of Energy, and one laboratory was 
chosen as a case study. Excluding those interviewed at Los Alamos National Laboratoiy (LANL), four directors 
of offices at DOE heatlquarters, eight division directors, and five program managers were interviewed. Since the 
Office of Energy Research (OER) is the primaiy supporter of basic research at DOE, the Executive Director of OER, 
six division directors, and four program managers were interviewer?. ;;ie Director of the Office of Weapons 
Research, Development and Ibsting; the Deputy Assistant Secretai^' f(,i Renewable Energy; and one program 
manager in the Office of Conservation and Renewable Energy were interviewed. In addition, departmentwide 
priority sening was discussed with the Under Secretary for Policy, Planning, and Analysis, and the chief planner 
for research. Finally, budget data were discussed with th« Deputy Director for Research in the Office of the Budget. 
At LANL, OTA staff toured the facility and interviewed the Deputy Director of LANL, the Director of the Meson 
Physics Facility, and the Deputy Director of the Health Research Laboratoiy, as well as a number of scientists and 
other members of the staff. 

In all agencies, the offices that support research were identified, as well as those that panicipatc in 
departmentwide planning. In addition, one or more inhouse laboratories were chosen for sire visits. Summaries of 
tlie interview results were prepared and distributed to all interviewees for comment (with the exception of DOD, 
where a smaller set of reviewers was selected). Because the number of people interviewed had to be limited, the 
analysis sought only to illuminate the stnicmre and diversity that characterizes executive branch decisionmaking 
in research. The table of organization was sampled to capture various perspectives on decisionmaking within and 
across the research agencies. 

SOURCE. Office of Tbchnology Assessment, 1991. 



.straiogif plaii to attain specific goal.s. Goals at the 
•'inacro level" (e.g., a he.sidetitial call for more 
research and development (R&D) in a .s{xicific aiea) 
do not nece.s.sarily map neatly into agency mi.ssion.s, 
and .some macro level goal.s ciuinot be addres.scd 
through current agency .structures. 

Agencies al.so have a good sense of their re.se;irch 
con.siituencie.s (i.e.. the .scienti.st.s that receive agency 
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funds), arid of what their future directions and needs 
will be. However, prognmis managers must often 
make tough deciraons within limited budgets about 
who to fund, whether to provide money for instru- 
mentation or personnel, and whether to favor disad- 
vantaged groups such as women, minorities, iuid 
young investigators. Competing goals of education, 
equity, and economic activity must be weighed in 
every program. 

BESTCorv: 
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Chapter 4^The Federal Research System: The Research Agencies • 99 



OTA found that peer review, manager discretioni 
and combinations of these methods are used by the 
research agencies to distribute funds. Since the 
beginning of the 1980s, the distribution patterns of 
research funding have been under great scrutiny. It 
is not only a matter of who should receive the funds, 
but how they are allocated (e.g., individual investi- 
gator grants or block grants to centers, short-term or 
long-term projects). 

In this chapter, the major research agencies are 
described, their priority-setting mechanisms out- 
lined and compared, and their funding allocation 
mechanisms discussed. Agency planning efforts and 
direction from other agencies of the Federal Govern- 
ment and the scientific community are analyzed. 

Priority Setting in the 
Federal Agencies 

Federal agencies initiate, manage, and terminate 
programs. At each step in the process, agency 
personnel must decide which program, or compo- 
nent of a program, will take precedence. What 
foUows is a brief introduction to each of the major 
research agencies and to their priority-setting 
mechanisms for research. The agencies are pre- 
sented in descending order of their annual research 
budgets. 

National Institutes of Health 

NIH is the largest research agency in the Federal 
Government in terms of dollars awarded to basic and 
applied research. It is the principal biomedical 
research arm of the U.S. Department of Health and 
Human Services (HHS), funding biomedical and 
basic research related to a broad spectrum of 
diseases and health problems both in its own 
research facilities (the NIH laboratories) and in 
external organizations. 

The missions of the institutes are reflected in their 
titles. There are categorical, or disease-oriented, 
institutes, such as the National Cancer Institute 
(NCI) or the National Heart, Lung, and Blood 
Institute (NHLBI). And there are institutes with a 
population-based research focus that is population 
based, such the National Institute on Aging. The 
exception to these categorizations is the National 
Institute of General Medical Sciences (NIGMS), 
which has no targeted responsibility other than 
general basic research. 
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Researcher trains hospital staff for a National Inetliutes 
of Health (NIH)-8pon&ored clinical trial of medical 
theraplea. Cllnloil triaia are an Integral part of 
NIH applied research. 

NIH is part of the Public Health Service, so its 
work is very much tied to public health issues. 
Although NIGMS is devoted primarily to basic 
research, the categorical institutes conduct a range of 
research from basic to applied to development. For 
example, NCFs mission is to implement programs 
on the cause, diagnosis, prevention, and treatment of 
cancer. Often, the missions of the institutes overlap 
with each other or with other agencies, in these 
cases, a lead institute will coordinate. Because many 
of the institutes are categorical, NIH and Congress 
tend to set their research agendas epidemiologically, 
focusing their mission on diseases of highest preva- 
lence. Critics of NIH question this approach, saying 
that it focuses the research agendas too much on the 
diseases of the majority, skewing research that could 
lead to health improvements in other areas. 

Since the 1960s, the goals and justifications for 
health research have been fairly constant — im- 
proving the health of the American people, curing 
particular chronic diseases, and contributing to the 
economic well-being of the Nation by producing a 
healthier work force. However, particular emphases 
have shifted. During the early 19i50s, mental retarda- 
tion was emphasized by President Kennedy. In the 
1970s, cancer and heart disease, which had been 
prominent research areas for decades, became even 
more important as President Nixon declared the War 
on Cancer in 1971. Mist sums of money were 
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dedicated to attempts to eradicate these families of 
disease with mixed success. Although levels of 
funding remained high, by the late 197^, the role of 
the environment in creating and reducing cancer risk 
replaced the earlier research focus on viral etiology 
and understanding cellular mechanisms.^ 

During the mid-1970s, the discovery of recombi- 
nant DNA shifted the emphasis of research once 
again, this time to biotechnology, which received 
inaeasing attention throughout the Reagan Admin- 
istration. Most recently, treating and curing AIDS 
has been a dominant goal of ^^H research. It first 
appears in the 1983 NIH budget authorization 
testimony,^ and every year since then AIDS has 
received the largest increases in research funding 
within the NIH budget. 

The fiscal year 1991 appropriation to NIH was 
just over $7.4 billion. NCI has the largest appropri- 
ation at $1-7 billion, foUowed by NHLBI at $1.1 
billion. The National Institute on Deafness and 
Other Communication Disorders had the smallest 
appropriation at $ 1 3S million. See table 4-1 for budget 
histories of the various institutes from 1970 to 1990. 

Each institute has an advisory council, which is 
appointed through HHS and is made up of scientists 
and lay people. Program officers must go before the 
council to present ideas for new programs, and 
councils review program balance. Each institute 
may also form advisory committees with program- 
nfiatic foci; for example, NHBLI has six committees 
to assist in specific fields. Committees help develop 
new initiatives. It should be noted, however, that the 
council is only advisory, except for its ability to 
approve or disapprove grant applications. 

When institute staff notice evidence of an emerg- 
ing area of research, they assess the importance of 



the new field and gauge interest and capabilities. 
They can then convene a meeting or workshop, write 
up a propospl for a new program, and go to their 
council for approval. If the program does not have a 
known constituency, an institute wUl often issue a 
request for applications. 

Some observers have criticized NIH in its re- 
sponse time to new research needs, such as AIDS 
and the Human Genome project. On the other hand, 
some scientists said NIH responded too quickly with 
its AIDS agenda. Interestingly, AIDS was incorpo- 
rated into the existing NIH structure, with the 
National Institute of Allergy and Infectious Diseases 
(NIAED) taking the lead. The Human Genome 
project, which some argued belonged in NIGMS, 
was placed in the Office of the Director. Both 
approaches have been simultaneously criticized and 
hailed.* lb date, there has been no mechanism for 
centralized planning at NIH. However, NIH, for the 
first time, is developing a strategic plan tliat cuts 
across all institutes. In addition, each institute 
submits its annual plan to the Office of the Director 
along with the budget. However, the Director has 
little authority to redirect the agenda of any institute. 
Through the budget process. Congress provides a 
coordinating function. 

Despite growth in funding over the last decade, 
NIH views itself as being in a "steady state" and 
under enormous strain. After experiencing phenom- 
enal growth (virtually a doubling of the budget in 
real terms during the 1980s), including an intramural 
budget that exceeds $900 million today, managers 
still feel they must juggle priorities, reorient existing 
programs, and make small, incremental changes in 
other programs — both intramural and extramural.' 
But there are exceptions: N1AD rose from seventh 
place among institute budgets to third place (from 



^Richard A. Rettig. Cancer Crusade: The Story of the National Cancer Act of 1971 (Princeton, NJ: Princeton Univenily Preii, 1 977); and Stephen 
Strickkind. Politics, Science, and Dread Disease (Cambridge, MA: Htrvwd University Pre«i, 1972). 

'Mark Pollack, "Basic Reiearcb Goal*: Perceptioni of Key Political Figures," OTA contractor reporU June 1990. Available through the National 
Ifechnlcal InformatloD Service, ice app. F. 

<Wilh matrix management, some National Imtitutcs of Health staffers said (in OTA interviews during the spring of 1990). the best way to tttpooi 
to a new research initiative is to create a new usociate director in the OOke of the Director to coordinate efforts among the irutitutcs. Also see liutitute 
of Medicine. The AIDS Research Program of the National Institutes of Health (Washington. DC: National Academy Press. 1991); and Janice Long. 
"AIDS Research; More Funds. Coherent Strategy Needed," Chemical A En$interint News, vol. 69, Mar. 11. 1991, p. A 

'Problems cited as besetting the National Institutes of Health (NIH) are: noocompeUtive wages (especially for young researchen), Increased 
politicization (noubly over fetal tissue research and the use of animals for experiroeoution). "accounUWllty fever" (centering on congressional 
investigations of purported misconduct in research and complaints about NIH's own process of inquiry), excessive papcirworit to document 
research-related decisions, and lack of direction (the difference between an "acting' ' and a presidentially nominated. Senate-approved director). Sec Rick 
WeUs. "NIH: The Price of Neglect." .5dfnc«f. vol. 25 1, Feb. 1 , 1991 . pp. 50R-51 1 . The conflraiation in March 1991 of Bemadine Healy u NIH Director 
filled a vacancy that existed since August 1989. See Lany Thompson, "NIH Gets Its First Woman Director," The Washington Post, Health secUoo. 
Mar. 26. 1991, p. 8. 



Table 4-1— National Institutes of Hsalth History of Congressional Appropriations: Fiscal Years 1970-90 (in millions of constant 1982 dollart) 

1970 1972 1974 1976 1978 1980 1982 1984 1966 19B8 1890 

NCr. $432.1 $814.6 $976.9 $1,207.1 $1,208.3 $1,166.7 $986.6 $1,004.3 $1,103.8 $1,211.3 $1,243.8 

NHLBI 382.4 500.2 536.3 586.4 620.4 61S.S 559.6 C54.5 754.3 796.0 816.1 

NIDR 68.6 93.3 81.5 81.3 65.5 79.7 72.0 62.4 90.7 104.1 103.3 

NIDOK 313.8 329.7 264.4 284.5 360.5 398.1 368.2 410.8 499.8 440.8 442.5 

NINOS 231.7 251.0 224.8 228.8 247.1 282.4 265.9 311.9 380.5 440.8 373.2 

NIAID 2317 234.6 205.7 201.1 224.8 251.3 23S.S 296.8 336.7 526.6 633.9 

NIQMS.... 353.1 373.1 311.7 296.8 319.7 364.6 339.9 386.2 452.0 521.6 518.9 

NICHD 181.2 250.3 232.4 216.2 230.5 243.9 226.3 256.3 282.5 327.1 337.1 

NRI 54.3 79.8 76.3 79.6 118 3 131.9 127.4 144.0 1 71.3 185.4 1 80.0 

NIEHS 41.4 56.8 52.0 59.7 88.9 97 9 106.3 167.7 1 73.4 1 77.8 1 74.4 

NIA rVa n/a n/a 30.6 51.7 81.7 81,9 107.1 137.4 160.6 182.3 

NIAMS.. n/a n/a n/a n/a n/a n/a n/a n/a n/a i21.8 128.5 

NIDCD n/a n/a ii/a n/a n/a n/a n/a n/a n/a n/a 89.5 

NCNR n/a n/a n/a n/a n/a n/a n/a n/a n/a 19.3 25.5 

NCHGR n/a n/a n/a n/a n/a n/a n/a n/a n/a n/a 45.3 

Other 236.0 255.3 333.5 376.2 382.0 287.6 270.3 331.4 445.1 462.9 471.5 

Total 2,526.2 3,239.1 3.315.6 3.648.3 3.937.S 4.001.1 3,640.2 4,172.3 4.620.0* 5.496.0 5,765.9' 

KEY: * ' 

NCI National C«nc«r InttituU NEi National Ey« Instituta 

NIHLBJ National HmtI, Lung, and Bk>od ln«tiiut« NiEHS National Inttituta ot Envtronmantal Haalth Sdancaa 

NIDR National Inatituta of Danlal Raaaarch NIA National Instltuta on Aging 

NfDOK National Inatltuta of Dtabataa and Df^Mllva and KkSnay CHsaasat NIAMS National tmtituta of Arlhrttta and Muiouloakalatal and Skin DIsaaMi 

NINDS Natlonallndituta of Neurological DWo^rt and Stroka NIDCD National Imtltuta on DMtnaM and OlhafCommunkationOitordart 

NIAID NattonaJ InttKuta o« AHargy and In(ac1k>u« DiMaAaa NCNR National Cantar for Nursing Ra^arch 

NIQMS National Inatituta of Qanaral Madical Sclanoa NCHGR Natkmat Cantar for Human Qanoma Raaaardi 
NICHD NatkMial Inatituta of ChIM Haaith and Human Dav«k}pfnant 

*R«flaot9 anactad admlnlatratlva raduotton ai>d saquattratkyn. 
NOTE; appfk^a 

SOURCE: Nattonal Inatitutas of Haalth, unpubllahad. Fabruary 19Q0. 
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almost $375 million to over $907 million) between 
fiscal years 1984 and 1991. AIDS research funds 
account for this increase, with one-half of the current 
NIAE) budget devoted to research on the disease. 
AIDS funds are new money, and are not taken from 
other biomedical budgets. 

NIH is perpetually struggling to balance its 
research and public health missions. Some institutes 
are more responsive to one or the other, and therefore 
are oriented to individual investigators (and basic 
research) or centers (and clinical, disease*focused 
work), but all seek to serve both missions. What has 
been especially inconsistent is the NIH approach to 
public health or research crises. As noted above, 
while the AIDS initiative was assigned to one 
institute. Human Genome, originally assigned to the 
Office of the Director, is now a separate National 
Center for Human Genome Research that is not part 
of the Office of the Director. Many argue that one 
approach or the other responds better to crises while 
remaining supportive of, and responsive to, develop- 
ments in basic research. Perhaps new efforts aimed 
toward a strategic plan could be used to better 
address public health and research crises.^ 

Department of Defense 

DOD is the second largest source of basic and 
applied research funds in the Federal Government. 
Justification for defense R&D throughout the last 
three decades has been to stay ahead of the Soviet 
Union in the development of new military technolo- 
gies. However, defense research is also inextricably 
linked to the expansion of knowledge and bolstering 
the overall U.S. technological base. 

The military funds research through three catego- 
ries: 6.1 — research of the most fundamental nature; 
6.2 — applied research and exploratory develop- 
ment; and 6.3A — the initial stages of advanced 
development.^ Research within DOD can be charac- 
terized by two phrases: "technology-push*' and 
^•requirements-pull.'* Knowledge gained from re- 
search creates areas for potential advancement, some 
of which were unforeseen when the research began. 



Figure 4-2— Basic and ApplM Rtsmrch Funds for 
DOD: Fiscal Yssrs 1960-90 (In billions of 1982 dollars) 
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NOTE: FiguTM wtrt convirled to contlant 1982 doftars using the QNP 
Implicit Ptkf Deflator. 1M0 figurea are eatlmataa. 

SOURCE: National Sdanoe Foundation. FedM FUrnk for Rwt^roh and 
D0V^pmm)t DaMM Histcricti/ TMbhs: FHcml Ymu$ 1955^ 
1990 (WaaNngton. DC: IMC). taUa A; and National Sdanoa 
Foundation, S^hotod D^m on FodomI Fund$ for Roswoh and 
Dovohpmont: Ffwa^ Y^m 1989, 1990 md 1991 (Washington, 
OC: Daeambar 1990). labfaa 4 and 6. 

This new knowledge nudges the system to incorpo- 
rate new ideas and thereby gain a greater level of 
capability (technology-push). At the same time, 
identified needs defme areas for research and 
technological results to enhance the military. These 
requirements shape the directions of research and set 
the level of effort to be pursued (requirements-pull). 

Figiu*c 4-2 presents the basic and applied (corre- 
sponding roughly to 6.1 and 6.2) research funds 
authorized for DOD from 1960 to the present.* 
Figiire 4-3 graphs basic research fimding in constant 



^Scc Institute of Mcsdicine. Funding Health Sciences Research, A Strategy to Restore Balance, Floyd B. Bloom and Mait A. Randolph (<ds ) 
(Washington. IMT: National Academy Prcsi. November 1990). 

^TYic reil of the 6.3 category \s devoted to more advanced development. U.S. Congress, Office of Tbchnology Asscasmenu Holding the Edge 
Maintaining the O^ense Technology Base, OTA'ISC-420 (Wiahington, DC: U.S. Government Printing Office. March 1989). 
iAi coDected by the National Science Foundation (NSF). Although some of the rcwch igenciea report pioblenw with the NSF survey 

(dlKUSsed below), the Department of Defense already categorizes its research with 6.1 and 6.2 budget designations. Funds reported as * •basic" and 
^•applied" correspond to 6.1 and 6.2 funds, and their interpreuUoo is fairly straightforward. 



ii2 



Chapter 4— The Federal Research System: The Research Agencies • 103 



Figure 4-3— Basic Research In DOD by Service: 
Fiscal Years 1969-90 (In millions of 1962 dollsrs) 



Figure 4^Applied Research In DOD by Service: 
Fiscal Yeara 1969«90 (in millions of 1962 doiisn) 
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ington, DC: DaoamlMr 1000), labtas 4 and 5. 
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r09O (Washington, DC: 1000), tabia A; and National Sdanoa 
Foundation, Sshcfad Data on Fad^ral Fundi for Ra$aarch 
and Davahpmant: Racai Yaars 1989, 1990 and 1991 (Wash- 
ington, DC: Dacambar 1000), tabtas 4 and 5. 



dollars for the three services, and figiire 4-4 presents 
applied research funds by service from 1969 to the 
present. Compared with basic research funding for 
other research agencies, the services show remark- 
ably little fluctuation in allocated funds, adjusted for 
inflation. The Navy has been consistently awarded 
more funds than ei^er of the other services, roughly 
twice that of the Army or Air Force. Although 
applied research funding decreased in the late 1960s, 
it has remained even more constant than basic 
research in the 1970s and 1980s, and the three 
services have received almost identical levels of 
funding for applied research since 1970. Basic and 
applied research is also supported by the Strategic 
Defense Initiative Organization (SDIO — although 
SDIO funds are technically categorized as 6 J A) and 
the Defense Advanced Research Projects Agency 



(DARPA). These two organizations often cooperate 
with the three services to fund and operate research 
projects. 

As recently stated by the Congressional Research 
Service: 

Although military basic research funding totals 
almost $1 billion annually, it (together with military 
applied research funding) has decreased since the 
mid-1960s in real dollar terms and relative to 
increases in total research, development, testing, and 
evaluation. Despite recent congressional action to 
increase military research budgets, executive branch 
decisionmakers have not sought large increases for 
research funding. As a result, critics say, too much 
attention goes to weapons development and too linle 
to ''creative*' science needed to produce knowledge 
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vital to U.S. natiotud security. Some allege that 
because of funding cutbacks the quantity and quality 
of militaiy research may be decreasing.' 

Recently each of the services concluded that a 
published strategic plan, explicitly covering their 
individual projections for the future technology 
base, would both aid in policy formulation and 
positively influence the budget for research. In the 
Air Force, it was called "Project Forecast 11;" in the 
Navy, "Navy 21;" and, in the Army, "Amiy 21." 
Some of these plans take into account the "new 
reality" for the future: the decreasing likelihood of 
a European war, the increasing likelihood of low- 
intensity conflict (especially in the Third World 
and/or connected with drugs), increasing global 
economic and technological competition, the de- 
creasing U.S. defense industry and R&D base, the 
decreasing supply of U.S. citizen scientists and 
engineers, and finally, decreasing defense budgets. 
Based on this future scenario, the plans identify key 
emerging technologies and areas for enhanced 
research. 

The three services differ in the degree of centrali- 
zation in the dispersal of 6. 1 money. In the Air Force 
and the Navy, almost all 6. 1 research monies flow 
through the Air Force Office of Scientific Research 
(AFOSR) or the Office of Naval Research (ONR), 
respectively. In the Army, 6.1 funds are more 
decentralized. 

Army 

Much of Army research is closely linked to 
priority settin<^ for all of the R&D ftmds in the 
Army's laboratories and institutes. Laboratories in 
the Army act independently, although they deter- 
mine priorities in relation to overall directives from 
Laboratory Command. With this indq)endence 
comes requirements for a high level of accountabil- 
ity, and laboratories are reviewed regularly. Most are 
"industrially funded" — competing for funds from 
sources within and without the Army. 

In addition, the mission of the Army Research 
Office (ARO) is to ". . . develop the Army Materiel 
Command research program for mathematics, and 



the physical, engineering, atmospheric, terrestrial, 
and biological sciences according to Army-wide 
requirements. Eighty-three percent of the re- 
search contract program monies go to universities, 
10 percent to industrial laboratcries, and 7 percent to 
Federally Funded Research and Development Cen- 
ters and not-for-profits.** ARO receives guidance 
from its parent Army Materiel Command, which 
provides focus to its research programs. ARO has 
also come to rely on informal types of outside input, 
especially from the scientists that it supports. The 
Medical Research and Development Command 
recently developed an Army Medical Ibchnology 
Base Plan, which provides guidance to the medical 
research community within the Army. Finally, the 
mission of the Anny Research Institute for the 
Behavioral and Social Sciences is to focus on 
"... the acquisition, training, development, utiliza- 
tion and retention of the Army's personnel re- 
sources."" Three laboratories and many university 
contracts support this goal. 

Navy 

Almost all of the 6. 1 research dollars in the Navy 
are disbursed by the Office of Naval Research. Over 
one-half of ONR funds go to universities, one-fifth 
to ONR laboratories, over 10 percent to other Navy 
laboratories, and the final 10 percent to industry and 
other government research organizations. ONR 
funding is spread among disciplines, with a little less 
than one-half devoted to areas of explicit Navy 
emphasis, such as ocean and atmospheric sciences, 
computers, and materials. Other areas of support are 
linked closely to broader defense interests: astron- 
omy and astrophysics; biological, medical, cogni- 
tive, and neural sciences; general physics, chemis- 
try, and mathematics; and energy conversion, radia- 
tion sciences, and electronics. 

In addition to Navy 21, ONR relies on inhouse 
personnel (including personnel from the ONR labo- 
ratories), foreign field offices, and outside experis 
and panels (including NAS) to help set priorities. 
This type of planning is relatively new for the Navy. 
Before 1970, a primary research criterion was the 
quality of the science. Most of the research was not 



*Oeoevieve J. Knezo. ' 'Defense Basic Reseaicb Piioritiei: Funding and Policy Issues." CRS Report for Congress (Wuhlogtoo, DC: Coagreuioowl 
Research Service. Oct. 24. 1990), p. 38. 

«>Anny Research Office briefing materials prepared for OlA, May 1990. 

"Ibid. 

"Ibid. 
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multidisciplinary and minimal advice was requested 
from the external scientific community. Now, due in 
part to the 1970 Mansfield Amendment, mission 
relevance is a strong criterion; multidisciplinary 
programs are enhanced and are greater in number; 
some programs can be put on a ''fast-track"; and 
substantial input is sought from the external scien- 
tific community. 

Air Force 

Before 1974, mhouse Air Force laboratories 
controlled most 6.1 monies. After 1974, the Air 
Force consolidated the disbursal of 6.1 monies into 
one unit, the Air Force Office of Scientific Research. 
Each laboratory still has a portion of 6. 1 monies, but 
the bulk are distributed by AFOSR. Air Force 
laboratories compete for these funds along with 
universities and other performers. In addition to 
Project Forecast II, each year key personnel in the 
Air Force research system and managers of the 
science and technology areas discuss the '^macro 
strategy'* for the next year. A report is then sent to 
the separate parts of the Air Force research system, 
such as AFOSR, which reinterprets its programs in 
terms of these goals. 

Even though there is a significant amount of 
* 'top-down" direction in the distribution of Air 
Force 6.1 money, it is still primarily a bottom-up 
process. The influence of top-down management is 
viewed as adding discipline to the management of 
research programs, which still respond primarily to 
scientific community concerns about the direction of 
research. The balance of top-down and bottom-up 
management seems intermediate to that in the Army 
where the management is more decentralized and 
bottom up, and to the Navy where ONR provides 
greater top-down management. 

DARPA and SDIO 

Project selection in research at DARPA is very 
different from that at other OOD research agencies. 
Project managers state that they are not attempting 
to maintain strength across a field, rather they are 
funding good ideas that are on the forefront of 
technology development to meet desired objectives 
(see box 4-B). 



In the Strategic Defense Initiative Organization, 
the Innovative Science and Ibchnology Office 
(ISTO) is the core unit that funds basic and applied 
research for SDIO. Within the overall mission of 
developing space surveillance, weapons, and com- 
munications technologies, ISTO detemiines future 
directions for research. ISTO includes an eight- 
person research management team, which sets goals 
and works to see that these goals are achieved. The 
measure of success is ISTO's impact on SDIO. 

At present the three services. SDIO, and DARPA 
set their own research agendas, gaining the usual 
advantages of pluralism. In a previous report, OTA 
also found disadvantages to pluralism, which in- 
cluded . . wasteful duplication of efforts, lack of 
critical mass to solve common problei^^is, fraction- 
ated efforts, and inattention to areas that are on no 
component's agenda. It also risks failing to identify 
areas of common or overarching significance."^^ In 
a mission-oriented organization like DOD, these 
disadvantages seem too large to ignore. OTA also 
found previously that the inability to define the 
products of research has limited DOD's use of 
quantitative decision support and evaluation meth- 
ods like those used in industry*^^ 

From 1989 to 1990, DOD prepared for a downturn 
in funding. After a period of phenomenal growth in 
the 1980s, DOD projected that such funding could 
not continue, and that a real decline in funds was 
therefore likely. DOD set in motion planning 
activities to construct useful options in such a 
funding scenario, such as the consolidation of 
several research laboratories, and many of the 
priorities embodied in these plans have been imple- 
mented in the DOD budget. The consequences of 
these decisions have yet to be evaluated. 

National Aeronautics and Space 
Administration 

NASA is now the third largest source of research 
funds (both basic and applied) in the Federal 
Government. NASA was created in 1958, 1 year 
after the launch of Sputnik, and took over the 
National Advisory Committee on Aeronautics' lab- 
oratories. In fiscal year 1960, the research budget 
was slightly ovei $0.5 billion (in constant 1982 



•'Office of Tbchnology Assessment, op. cil., fooUKHc 7. 

'^U.S . CongrcM. Offtce of Tbchnology Assessment, * 'Evaluating Defense Department Research, * * backgTouud ptper of the Intermtioual Security and 
Commerce Program, June 1990. 

115 



106 • Federally Funded Research: Decisions for a Decade 



Box 4-B— The Defense Advanced Research Projects Agency 

Because the cieatioQ of new technologies is often inteidiic^lintty and involves risky itsesich ventures. 
President Eisenhower fett that **. . . • differant type of oifaniialioQ was needed with unique business pnctices."* 
lite mission of the Defense Advanced Research ftojects Agency (DARPA). created in 1958. is to . deveilop 
'revolutionary' techndogiet that can make a significant impact on the Amue of the United States' defense posture, 
and to ensure that those technologies effectively enter the appropriate fbfoes and supporting hidustry btse.' '> 

The '^unique business practices" that now prevail at DARPA invoke program managen directfy with the 
projects that they fimd and manage. Managers typically create a portfolio of research projects se«ddog paiticukr 
objectives, such as the use of Gallium-Arsenide in new micro circuitry developments, and follow them closely. 
Programs are expected to Ust 3 to S years; the manager is given abnost total discretion ov«ir fimding allocation; and 
the success of the manager and the program are judged oy the results produced. 

Managers are also given discretionaiy money to pursue ideas for foture programs, and every year new prognuns 
compete for ftmding, DARPA stresses that this competition is based almost exchuively on the worthiness of a 
particular idea, not on external considerations such as maintaining U.S. strength in a particular research field. Also, 
DARPA's contribution must be unique. An "inhouse nile" stresses that 80 percent of the fimding in a particular 
research area must come from DARPA. This targets DARPA's investmem in emerging sesearvh topics. 

DARPA fiirther stresses the importance of allocating enough Amds for a project to see it through to completion. 
Because of funding shifts, many agencies must compromise their programs and projecu by allowing only partial 
funding. At DARPA. programs and projects are routinely terminated to make way for others. 

Among Uie agencies where OTA conducted interviews. DARPA is applauded as Uie only organiiaiion that can 
effectively trade off agency programs and, if needed, stop a project. DARPA allows less tium 1 year to switch 
program direction, whereas research managers in many otfter agencies state that it takes at least 2 years, and often 
much longer, to achieve such redirection. DARPA relies foremost on program managers to detemiine when to halt 
a program, which is hailed as a key to DARPA's success.^ / 

DARPA's accomplishments in high-performance computing, solid state devices, advanced materials, and 
many other areas have sparked much congressional imerest.jAttempts to model odier agencies after DARPA, 
particularly a "Civilian Advanced Research Projects Agency," have concentrated on DARPA's novel 
organizational style.^ Congress could also consider instr)iding the Federal research agencies that do not already 
have programs specializing in high-risk research to 0e|>t select DARPA management techniques. 



>Cfijg I. Fields, Kitlmooy at beariogi before the House Coomitiee oo Aimed Sovices, Subcommittee on Reiearcb and Development, 
Mtt. t, 1990. p. 1. Also see "The Goveraneot's Guiding Hand: An Iniiavtew With Ex-OARPA Director Craig Fields," lichnologv Review. 
February-Marcb 1991, pp. 33-«. 

2lbld.,p. 1. 

'See Tbd Agres. "DARPA Beu <m Hlgb-Rlsk R*D," Research & Development, November 1989, Ri, 39-42. 

^See Senate and House bills: S. 1978 and H. 3833: and Senate Committee on Govemmeot ACfain. bearing on S. 1978. Tiade IfachnoloKv 
and Prwnodon Act of 1989, June 12, 1990. 



dollars) and. by fiscal year 1990. it had surpassed $2 
billion (in consiant 19S2 dollars, see again figure 
4-1). 

Not unexpectedly, the primary locus of NASA 
resciirch from 1961 to 1969 was directed at achiev- 
ing President Kennedy's announced goal of huiding 
men safely on the Moon by the end of the decade. 
The u.sc of satellites for communications, meteoro- 
logical observations and research, iuul Earth re- 
.source surveys were also persistent empha.ses. The 
investment in space was justified on the basis of 
perceptions of U.S. leadership in science, technol- 



ogy, and world affairs, and of expanding knowledge 
of the universe. As the economy tightened imd the 
lunar hinding neared. the ostensible practical bene- 
fits of space re.sciirch and of space-related technol- 
ogy received increasing emphasis. The end of the 
Apollo program produced a need for new priorities 
Ixjth to guide the agency's activities juul justify 
continued high levels of funding. In the mid- 1970s, 
the Space Shuttle began to move to center .stage. 

During the I9«0s, le.seiuch priorities at NASA 
diversified. NASA began to emphasize commercial 
uses of space (including indusuiiU resciirch), a.s well 

lu, BEST copy i^!'-?:''- 
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Photo erodi: National AtmnauVca and Spaca AdmlnlstraOon 

Sdenllsts work on a mirror for the Hubble Space Telescope 
(HST). Building the apparatus for any mission In space, 
such as the HST, Is complex and involves niany 
different components. 

as the use of space for defense. In addition, NASA 
initiated work on the Earth Observing System to 
collect much more environmental data than had 
previously been collected from space. Recently, 
President Bush has also set a goal to return humans 
to the Moon and explore Miu-s. 

Basic and applied research management at NASA 
is split between the Office of Space Science and 
Applications (OSSA) and the Office of Aeronautics, 
Exploration, and Tfechnology (OAET). Data on 
basic and applied research funding at NASA are 
presented in figure 4-5. Over the last three decades, 
basic research funding has oscillated slowly, be- 
tween $600 and $800 million (in constant 1982 
dollars). Applied research shows a more active 



Figure 4-5~Basle and Appllad RasMreh Fundt at 
NASA: Fiscal Yaara 1960-90 (in millions of 1982 dollars) 
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Davahpmant, Datallad mtortcal Tablaa: Fiscal Yaars 1955- 
1990 (Waahlngton, tX): 1990), labia A; and National Sdanoa 
Foundation, Salactad Data on Fadaral Funds for Rasaarch and 
Davahpmant: Fiscal Yaan 1989, 1890 and 1991 (Waahkiaton, 
DC: Oflcamber 1990). taUas 4 and 5. 

history, ranging from $0.8 to $1.6 billion (in 
constant 1982 dollars), but in the 1980s applied 
research has held fairly constant at nearly $1.0 
billion. 



OSSA sets priorities in conjunction with the 
budget process and by selecting specific projects. 
The process is essentially bottom up with project 
managers proposing new initiatives. However, when 
large missions are propo.sed, such as Space Station 
Freedom, top-down direction will determine the 
parameters of the effort. OSSA recently produced its 
first strategic plan, which emphasized a commitment 



.1. . T ^ tgencics do not find the division into basic, applied, and development useful. Consequently, agency budget ofTices bcUevc 

dui the data dui Ihcy report to U« National Science Foundation (NSF) is srtificijU and prone to enors. TTic NSF figures also rcnwve the funds fof 
equipment purchase from the research and development (RAD) budget line items and add the support funds from the Research and Program Management 
appropriauon associated with R&D. OTA uses these data only as a general indicator of level of effort in particulai areas '^a^cmmi 
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to the Space Station Freedom and the Earth Observ- 
ing System and to flying a mixture of small and large 
missions. 

The National Research Council (NRC) plays a 
particularly strong advisory role for OSSA, and the 
Space Studies Board provides input for most NASA 
basic research programs. The board is unique at 
NRC because it has an institutional relationship with 
NASA, i.e., NASA funds the board and requests 
many studies, but the board can use these resources 
to initiate studies independently. In fact, the board 
has been able to preserve its credibility because it 
has not always agreed with NASA, and has openly 
disputed it on some occasions. Roughly every 10 
years if events do not call for an earlier revision, the 
board writes a strategic plan for every discipline in 
OSSA. The Space Studies Board also conducts 
periodic reviews of the programs and every new 
mission, and other larger topics such as "manned" 
V. "unmanned" flight are routinely studied. 

In addition, OSSA has an internal structure of 
advisory panels. The panels are usually made up of 
representatives from academia, industry. Federal 
laboratories, and other interested groups such as 
program managers from other agencies. They are 
consulted at least once or twice each year (sometime 
quarterly) about future directions for research pro- 
grams. However, as with NRC, their findings are 
never binding. 

In early 1990, "exploration" was added to the 
Office of Aeronautics, Exploration, and Tfechnol- 
ogy, formerly the Office of Aeronautics and Space 
Tfechnology. The new program participates fully in 
the Adminis&ator's Moon/Mars Initiative, which 
gives it a new and higher profile within the agency. 

The aeronautics work in OAET is almost all basic 
and applied research, and OAET views its role as the 
basic research provider in aeronautics for the coun- 
try. Consequently OAET's advisory committees are 
primarily composed of and almost always chaired by 



industry representatives. Generally the decisions of 
research direction are made by the associate admin- 
istrator. It is a somewhat open process, in which 
there is ample chance for those outside NASA to 
comment. 

In the 1970s and into the 1980s, OAET's space 
technology component asked of project directors: 
"what will they need for the future?" In 1986 and 
1987, the program changed its philosophy. It fo- 
cused on short-term problems and attempted to 
promise system delivery by specific dates. In 1989, 
the deputy administrator questioned this approach. 
Now 60 percent of the funding goes to near-term 
solutions to mission problems; 30 percent to long- 
term solutions; and 10 percent to high-risk research. 
The first 90 percent is developed in conjunction with 
mission managers, and the rest is decided within the 
space technology group, and can be used to support 
risky research, such as studies on "wormholes" — 
shortcuts between distant points in space. 

Recent problems have plagued many NASA 
programs, such as a flaw discovered in the Hubble 
Space Tblescope, the halt of space shuttle flights due 
to hydrogen leaks, and nagging questions about the 
Space Station. A reflective look at NASA programs 
by Congress has been urged, and calls for an 
overhaul of NASA's management stnicture have 
grown louder.'^ Director Truly has cited the need for 
a better match between agency programs and its 
resources. In addition, many have pointed to the 
failure of NASA programs to encourage a civilian 
space industry that also supports research. While 
NASA has been charged (since 1960) to promote a 
civilian space capability, it has been successful to a 
lesser extent than predicted one, two, and three 
decades ago." An Advisory Committf? on the 
Future of the U.S. Space Program has reviewed 
NASA's programs and has suggested such goals as 
building a reliable space transport system, improv- 
ing NASA's civilian pay structure, and augmenting 



"Fof cxampte. tee D«vldC. Morriion. ■■Hill .i NASA: Come Down." NailonaUournal. vol. 22. No. 18. May 5. 1990, pp. 1077-l(«r. lUthy Sawyer. 
•Tnily: NASA Necdi More Ftenibility.'^ The \^jthinglon Poti, Sept. 14. 1990. p. A17; tod Kalhy Sawya. "NASA: Miukm ImplauaiWe." The 
Washington Post, Nov. 4. 1990. p. C3. 

•'See Mark R- Oderraan. "A Viewpoinl on Commercial Space Aclivilics: Realities and Options for the 1990«." Science. Technology, and the 
Changing World Order, colloquium procceJingj. Apr. 12-13. 1990. S.D. Saua (ed.) (WajWngton, DC: American AwociatioD for the Advancenacot of 
Science. 1990). pp. 253-264. 
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NASA facilities.^^ 0MB and the National Space 
Council have been directed to create an implementa- 
tion plan based on its suggestions.^' 



Department of Energy 

DOE is the fourth largest source of basic and 
applied research funds in the Federal Government. 
DOE is also the youngest of the six rn^or research 
agencies. Created by the Carter Administration to 
succeed the Energy Research and Development 
Administration* DOE inherited a strong research 
base from another predecessor, the Atomic Energy 
Commission » including the national laboratories and 
a network of university researchers. 

V/hen DOE was founded* in the wake of the 
formation of OPEC and the subsequent Arab oil 
embargo, its top priority was to lessen U.S. depend- 
ency on foreign countries for meeting its energy 
needs. At the same time, rising concern with 
environmental issues such as water and air pollution 
spurred research on developing cleaner, more effi- 
cient energy sources. Nuclear power was an avenue 
frequently stressed, although the accident at Three 
Mile Island in 1979, compounded by cost concerns, 
seemed to slow work on fast-breeder reactors, llie 
Carter Administration also placed particular empha- 
sis on achieving short-term results through work on 
conservation, cleaner burning coal, solar electrical 
power, and other sources. 

The 1980s saw a marked shift in the priorities of 
DOE, emphasizing long-term rather than short-term 
research and stressing the role of the Federal 
Government as a risk-taker, pursuing research proj- 
ects that, if potentially profitable, are to be turned 
over to the private sector for demonstration and 
commercial development. The Reagan Administra- 
tion emphasized basic research over applied re- 
search, cutting the latter in the mid-1980s while 
increasing basic research markedly over the same 
period (see figure 4-6). 



Figure 4-6— Basle and Applied RsMareh at the 
Department of Energy: Fiscal Years 1980-90 
(In millions of 1962 dollars) 
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D4¥0hpmnt, DtaM Hi$forkMl TM—: R9oti Vaa^ t055- 
f 090 (Washington. DC: 1990), tablaA: and National Sdanoa 
Foundation, 34hcM Oafa on FmknU FundB tor RmhucTi 
9ind O^y^hprrmt: Rbo^I Y^m 1999. 1990 md 1991 (With- 
litgton. DC: Daoambar 1990). tabiat 4 and 6. 



In general, priority-setting mechanisms for re- 
search at DOE appear to be very much like those at 
DOD and NASA in the 1960s.^ However, compared 
with other agencies, less accountability is required 
from project to project. This is not to say that 
accountability does not exist. DOE is responsive to 
the scientific community and to the rest of the 
government. Research managers outside of DOE 
envy DOE's flexibility, but see the tradeoff as a loss 
of excitement in working toward a defmed goal. 



••See Advisory Committee on the Future of ihe U.S. Space Progiftin, Report of the Advisory Committee on the Future of the US. Space Proftram 
(Washlngtoo, DC: U.S. Oovenuneot Printing OfHce, Dece2nt>er 1990); and Philip C. Abelsoo, "Ptiture of tbe U.S. Space Progrun/ ' Sviertce, vol. 251. 
Feb. 25, 1991. p. 357. 

i^Geoe Koprowiki. '*OMB to Join Summit oa Space Report,'* Waihingtott Tech/wlogy, vol. 5. Dec. 20, 1990. p. I. 

the defease profrtim, dtboufh nuclear weapons rcietrcb occurt within both the Dep«rtmcot of Bnergy (DOE) and the Depanmeol of Defense 
(DOD). tiiere is a clear division of labor. DOD builds the delivery systems and DOB produces tbe nuclear weapons to go inside them, lb set goals, every 
2 yean a document cocoes from the Pentagon called *'Nuclear Weapons Development Guidance/* It outlines tbe requirements of future systems. Based 
on this document, supplemented with threat assessmenu and otiier analyses, the D0£ defense group decides the future direcCioo of their research 
programs. Genetally no large rediieclion is required. 
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They wonder, too, about DOE's accountability to 
basic and applied research missions.^' 

Recently, the Secretary of Energy attempted to 
institute more strategic planning within DOE. In 
particular, he created a National Energy Strategy 
(NES) with input from the offices within DOE and 
from external advisors. The planning process for the 
NES required planning at all levels of DOE, and 
Secretary Watkins has sought to maintain and 
further this planning function at DOE. As it is too 
early to observe the changes in response to these 
initiatives, OTA cannot judge their effectiveness, 
but such plannbig is reportedly beneficial at other 
agencies. 

In the Office of Energy Research, programs such 
as Basic Energy Sciences and High Energy and 
Nuclear Physics use an "iterative" process of 
priority setting — where ideas are proposed (with 
origins both within and without DOE), feedback 
from the scientific community and other parts of 
government are received, and the proposal is re- 
vised — to detenmine goals. In particular, as national 
goals are defined and new ideas arise from either 
within DOE or without, the program will first 
consider them internally. If the new initiative would 
fit into the existing program or complement it, then 
the idea will be fielded to a wider audience. 
Sometimes this audience includes only other parts of 
the agency. DOE may, however, hold public work- 
shops and/or panel meetings to devise a plan of 
action. 

If a plan is codified by the Office of Energy 
Research (OER) or within one division, it is sent out 
for review to DOE personnel, academic and indus- 
trial representatives, and other interested parties. 
This method of fielding new ideas requires much 
responsiveness on the part of DOE to groups outside 
of die agency, including the scientific and industrial 
communities. This method also develops strong 
working relationships with these communities, but it 
can have its drawbacks. For instance, some manag- 
ers complain that the scientific community tries to 
dictate on occasion (and more than at other agencies) 




Phofo ormM: U.S. Dtptrtnmt of Energy 

Resaarcher at Oak Ridge National Laboratory studies 
the health and environmental effecta resulting from 
synthetic fuels conversion processes. The Department 
of Energy sponsors research In many Ixoad 
scientific areas. 

plans that could never gain either the finances or the 
political support necessary to emerge as new pro- 
grams. 

Complicating decisions on priorities is the fact 
that DOE has a very broad research base. For 
example, under OER, the Basic Energy Sciences 
program considers its mission similar to NSF. As 
one manager put it: "...the research that we 
support is as broad as NSF's, but with a different 
emphasis." Also, with the major cuts in applied 
energy research funding during the Reagan Adniin- 
istration, the applied programs in offices outside of 
OER lost much of their research function. They now 
may look to OER to develop needed research 
programs. 

In addition, each program has an advisory panel, 
such as the High Energy Physics Advisory Panel. 
Until recently there was also an overall advisory 
committee, the Energy Research Advisory Board 
(ERAB), which reported to the Director of Energy 
Research and the Secretary of Energy. This group 



^'Cooiider for cwunpJc. ibe Dqwrtnjem'i wnbivtleDce over nA ctteckered funding hiitory of ihe ftuloo nawtfchprognm. Puiion ii «eeo by amy 
« the beat long-tcm altcnuulve to fouil fuel energy dependence. U.S. pwticlpadon in ■ major inuian»tion*l effort to deiign ■ fuikm eoeigy teit reactor, 
the Intemationil Tbmnoouclcar Experimental Reactor, raa/ki a renewed commitment that ii reflected In the Admlnittradon'i fucal year 1991 budget. 
See Mark Crawford. "U S. Backing for Fusion Project Seen.'" Science, vol. 25 1. Jan. 23. 1991, p. 371; and Chriitophcr Andenon. "DOB Rallies to 
Save U.S. Fiitlon Re«archPn«ram." Nature, vol. 349. Jan. 24. 1991. p. 269. 
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was disbanded in early 1990, and the Secretary has 
formed the Secretaiy of Energy's Advisory Board 
(SEAB), which is already in operation. SEAB's 
charter has been expanded beyond the scope of 
ERAB, to include advice on the National Energy 
Strategy and on the role of the national laboratories. 

In the late 1970s and early 1980s, while the 
Reagan Administration was entertaining notions of 
abolishing DOE, many interviewees said that the 
planning for DOE's research was more external to 
the agency, with NAS and other organizations 
playing key roles. Program shifts were primarily 
budget controlled and long-term goals often suf- 
fered. Furthermore, many decisions on specific 
programs were dictated by the scientific community 
they served. The interviewees state further that the 
system has now evolved so that DOE can make 
decisions that balance external as well as internal 
forces. This is accomplished primarily through riie 
iterative process described above. Differences be- 
tween programs are due primarily to the constituen- 
cies and the types of problems addressed, but 
differences are also due to historical tradition. 

In the applied research offices of DOE, processes 
of goal setting are also iterative. Most ideas are first 
taken up internally, and then may be augmented by 
contractor reports. After much deliberation, they are 
taken to the public. Five-year plans are written for all 
new programs and receive extensive review. 

In the late 1970s and early 1980s, the process of 
priority setting for applied research was inward 
looking. Now with the large consulting process 
described above and participation by industry, DOE 
perceives that it is better serving its "client"— the 
energy industry — and thereby the public. During the 
Reagan Administration, the emphasis was on fund- 
ing research that was too risky for industry. Under 
the Bush Administration, the emphasis seems to 
have shifted toward projects perceived to have the 
highest payoff for industry and DOE.^^ 

National Science Foundation 

NSF is the fifth largest source of basic and applied 
research funds in the Federal Government. Estab- 



lished in 1951, it has evolved into an agency 
composed of eight directorates in addition to the 
Director's Office. The Director and Deputy Director 
are appointed by the President and serve 6-year 
terms. Five of the directorates fund basic and applied 
science and engineering; another two focus on 
education, human resources, data, and policy; and 
one handles NSF's administrative matters. On aver- 
age, each directorate has five divisions. Each divi- 
sion has several programs. 

The primary role of NSF is to support basic 
research and science education across broad catego- 
ries of science and engineering. This is done 
primarily through support for university-based indi- 
vidual investigators, who absorb over 60 percent of 
the research budget. Aggregate support to groups 
and centers represents a small portion of the budget 
(less than 10 percent) and is more sensitive to budget 
fluctuations. ^3 Support for individual investigators 
is considered the primary mission, even by those 
managers with portfolios covering group and center 
support. 

A number of research administrators at NSF 
prefer to use the terminology "fundamental v. 
directed" rather than "basic v. applied" in making 
distinctions between categories of research fund- 
ing. In using the former terminology, they are 
likely to respond that they fund both (but much more 
fundamental than directed). In using the latter 
terminology, they are more likely to say they fund 
only basic research. Most administrators say that 
they never give a grant with applications in mind, 
but they are pleased when grantees cite NSF-funded 
work when seeking patent applications. 

In its fu-st operating year, the NSF budget was 
$151,000. In constant dollars, the budget has grown 
over NSF's history, although not consistently (see 
table 4-2). The NSF budget authority for fiscal year 
1991 is $2.2 billion. Cunently, NSF funding is 
provided in six separate appropriations: Research 
and Related Activities (R«StRA); Education and 
Human Resources (EHR, formerly Science and 
Engineering Education); U.S. Antarctic Program; 
Facilities, Program Development and Management; 
and the Office of Inspector General. R&RA has 



»For example, icc Alan Schricsheim. "Ibward a GoWco Age for Ttchnology Transfer." Issues in Science A Technology, vol. 7. winter 1990-91. 
pp. 52-58. 

IB f /'"''il"' ^^^'^^ Foundation. Report on Funding Trends and Balance of Activities: National Science Foundation J95JJ988. special report. N.SF 
**OTA interviews at the National Science Foundation, spring 1990. 
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Table 4-2— National Selanca Foundation Ot)llgatlons: 
Flaeal Yaara 1952-90 
(in mtlllont of conttant 1962 dollars) 



Research and 

Year Total obUgattens related actlvlttes 



1QS2 $ 13.6 $ 7.6 

1654 28.6 23.1 

1956 54.8 44.4 

1658 159.7 102.1 

1960 494.1 287.0 

1962 765.2 548.8 

1964 1,049.1 724.3 

1966 1,316.5 942.7 

1968 1,319.2 942.0 

1970 1,100.2 783.6 

1972 1,292.9 1,032.2 

1974 1,195.7 1.000.4 

1976 1,148.1 972.0 

1978 1,187.3 1,017.9 

1980 1,138.6 983.6 

1982 999.1 909.7 

1984 1,213.4 1,065.0 

1986 1,311.9 1,140.0 

1988 1,420.1 1,202.?. 

1990 1,586.7 1.312.9 



NOTE: FIcccI y«ar 1990 fifiurM «r« Mtlmatw. 

SOURCF.: National Sd«no« Foutxlatlon, fhport on FuncSng Trmti t/id 
BalMPM of ActMtlt$: Nation^ Sd0ne»Foijndtiion, 1951-1988, 
•pKlal raport, N.<)F S8-3 (Wuhinoton DC: 1968); and Nadonal 
Scianoa Foundation, pra«s lalaaM, PR 90^. Jan. 29, 1990. 

accounted for more than 70 percent of the budget 
since 1967, and 80 percent or more since 1982. EHR 
has l>een the most variable, ranging fiom 46 percent 
in 1959 to a low of 1.5 percent in 1983. It i& also the 
target of recent inCTcases, approaching an all-time 
high of $322 million of NSF's $2.2 billion fiscal year 
1991 budget. 

Within directorates, research funding is vei7 
much a bottom-up process. Goals are set by scien- 
tific opportunity and the proposal process, as well as 
in special initiatives from advisory panels. Through 
its grants program, NSF receives proposals for 
reseairch spanning the fullest range of science and 
engineering. The scientific community is NSF's 
constituency, and program staff project a strong 
sense of obligation and commitment to that commu- 
nity. There is an explicit ethic pervading the 
directorates that discourages heavy>handedness in 
the setting of priorities. Staff serve as interjnvters, 
advocates, and jurors throughout the priority-setting 
and planning piocess. 

An exception to the above lies in the Engineering 
Directorate. Created as a separate unit in 1983, 
Engineering lends to set its priorities around national 
needs. For example, a recent initiative involved a 



Request for Proposals in design and manufacturing 
systenu. It was the sense of HSF staff and its 
advisory committees that there was a need for 
research in those areas. In addition, the Engineering 
Directorate tends to address problems more cen- 
trally, and many areas of engineering are cross- 
disciplinary. Tb this extent, the diviiions of Engi- 
neering, and the methods by which they set priori- 
ties, differ somewhat from the way other directorates 
operate. 

The agency primarily sets priorities and plans 
through a process described by many as . . contin- 
uous, open, and decenlraliced." The decision cycle 
is keyed to the annual Federal budget and annual 
appropriation cycles. Eight populations provide 
formal and informal input into the planning process. 
They aie: 1) the National Science Board (NSB); 2) 
advisory committees; 3) professional societies; 4) 
NRC; 5) Visiting Scientists, Engineers, and Fxluca- 
tors (also known as "rotators"); 6) NSF staff; 7) the 
Inter-Directorate Tft.sk Force; and 8) Congress. 

Each spring, the advisory committees meet with 
program managers and division directors to recom- 
mend priorities for the current year and years to 
come. Besides scientific opportunity, staff usually 
recommend that NSF not fund research already 
well-supported by other agencies. 

Plans are eventually forwarded to NSB for consid- 
eration at their June meeting. A strategic plan is 
developed that must bt*. set against the general 
recommendations of NSB, For example, in 1989, 
NSB decided on four general iniorities for NSF to 
pursue — international cooperation in research, edu- 
cation, economic competitiveness, and better meth- 
ods for leveraging Federal dollars (i.e., to share 
funding with other — typically State or privat^— 
sources). If an organizational unit within the agency 
proposes a new program that covers all or most of 
these priorities, it has a very good chance of getting 
a proportional increase in its budget. For example, in 
the late 1970s it was decided that tliere should be 
more fluids for the physical sciences in the 1980s; in 
the 1980s it was decided that in the 1990s NSF 
should focus on building strength in engin^ng and 
computer sciences. The mid- to late 1990s should 
bring more funds to environmental sciences and 
geosciences. National needs are very much a part of 
the planning process. 

In addition to planning conducted on a program 
basi.s, there has been increasing attention paid to 
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planning on an activity basis; by whom and how will 
research be conducted? This has resulted in more 
support for women and nniinorities and broader 
geographic distribution of funds. Between 1985 and 
1990, support for the individual investigator went up 
25 percent as compared to other research funding 
modes, such as groups and centers. 

NSF faces a daunting task-~being all things to all 
people. The organic act entrusts it with the support 
of the Nation's basic research and science education. 
(Thus, every research program at NSF has an impact 
on human resources.^^) Witliin the scientific com- 
munity, however, there is growing concern that NSF 
has reduced its flexibility by relying too strongly on 
traditional mechanisms to set priorities and allocate 
funds. While not wishing to abandon peer review, 
NSF has sought some alternatives. A recent report, 
which addresses these issues of emphasis and 
process from the perspective of senior staff, stresses 
that NSF must serve all research performers, stream- 
line the proposal process, and better integrate human 
resources with research funding considerations.^^ 

Department of Agriculture 

USDA is now the sixth largest source of basic and 
applied research funds in the Federal Government. 
USDA has a long history of support for research, 
especially when compared with other government 
agencies. In 1862, the Morrill Land-Grant College 
Act recognized the importance of agricultural re- 
search and education by setting aside Federal land 
for agricultural colleges. In 1887, the Hatch Act 
created the State Agriculmral Experiment Stations 
and assigned administrative responsibility for them 
to the land-grant institutions. During this time, 
USDA also grew in power as a research provider, 
creating an expanding research network.^'' 

In the late 1960s, environmental problems began 
to donrunate discussions of research in agriculture, 



with particular concern expressed for fmding alter- 
natives to the use of chemicals as pesticides and in 
fighting plant and animal disease. Throughout the 
last three decades, research on human nutrition has 
been stressed, as well as with fmding means for 
improving the productivity of American farms. 

R&D funding levels for USDA since 1955 are 
tabulated with the other agencies in table 4-3. In 
constant dollars, USDA R&D funds have hardly 
grown since 1965. For basic and applied research, 
the figures are similar. In 1960, USDA research 
funds totaled just under $0.5 billion. Throughout the 
1960s, 1970s, and 1980s, their total grew steadily, 
but declined from 1985 to slightly under $0.8 billion 
in fiscal year 1988. 

USDA is advised by many groups. Most impor- 
tant is the Joint Council on Food and Agricultural 
Sciences (JCFAS), created by an act of Congress in 
1977 to coordinate and encourage research, exten- 
sion, and higher education in agriculture. Its mem- 
bers include influential representatives from public 
and private sectors, producers, industry, and govern- 
ment; as well as directors of research, extension, and 
higher education activities in universities, agricul- 
tural experiment stations, and other centers. While 
JCFAS has the mandate to evaluate and recommend 
changes to USDA programs, it cannot direct USDA 
to institute them. Another advisory body is the Users 
Advisory Board on Research and Education, with 
membership selected from those who benefit from 
research and education. These and other groups 
advise the various research components of USDA. 

Agricultural Research Service (ARS) 

ARS was established in 1953 as USDA's inhouse 
agricultural research agency.^ The National Pro- 
gram Staff (NFS) is a core component of ARS 
headquarters and is responsible to the administrator 
for planning, developing, and coordinating the ARS 



Although the Nttiofial Science Foundation'i (NSF) ibAre of the total Federal research arid development budget rtqueited fof fiscai year 1992 ii only 
3 percent^ iu education and human resourcei programs represent 23 percent of the total proposed Federal agency effort. ?rograma vuch ai Research 
Experknces for Undergraduates (which is tinted to support almost 12.000 students) art Inaeasingly visible. See Frederick M. Bemthali acting director* 
National Science Foundation, testimony at bearings before the House Committee on Science, Space, and Ibchoology. Subcommittee on Science. Feb. 
20. 1991. pp. 7-8. IL 

^Scc NsUonai Science Foundation, Report of the Merit Review Task force ^ NSF 90^1 13 (Washington, DC: Aug. 23, 1990): and Jeffrey Mcrvis, 
•'Panel Weighs Overhaul of NSF's Grant System.'* The Scientist, vol. 5, No. 1, Jan. 7. 1991. pp. 1. 6-7. 12. 

2^UwTencc Busch and William B. Lacy, Science. Agriculture, and the Politics of Research (Boulder. CX>: Westview Press. 1983). 

2«CcotraJ onkes of the Agricultural Research Service (ARS) arc in Washington, DC» and BelitvUle. MD. There are apjroximately 7.000 fuU-tmie 
onployeca (of which 2.350 are scientisU) icattcrcd across the United Stales. Puerto Rico» the Virgin Islands, and several foreign countries. Research 
is conducted at 122 domestic and 6 overseas locations by civil lervice scientists. Last year there were about 1,700 projects ongoing with budgeu ranging 
from SIOO.OOU to $1 million Much of the worit of ARS is conducted in direct cooperation with the SUte agricultural experiment sutions. other Stale 
and Federal agencies, and private urginizauous. 
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Table 4.^Trand9 In Federal Obllgatlont for Total Research and Development. 

by Major Agency: Fiscal Years 1955^ (in million* of con»tant 1982 dollari) ^ 

All TWai 

other nondefense 

Year USDA HHS NSF DOE NASA apenctos agendCB POD 

7^ ; ~ $^ $~327 r~4i ^$1,574 $ 207 $ 325 $ 2,586 $0,591 
*i05 1.284 300 3.059 1.483 759 7.390 22.938 

«5 :;::: ^1 sow 4.353 17.374 i.ise 27.525 23,753 

S?0 738 3 205 758 3.533 9.974 2,410 20.941 19.319 

IIjs 72? iiS 1,031 3.548 5.311 2.603 17.376 15.620 

980 . 804 4 421 1.031 5.560 3.783 2.938 18.357 16.352 

i985 r: ::: : : 337 4865 1.195 4.410 2.955 2.227 16.490 25.458 

1988 778 5.079 1.379 4.027 3.636 1.862 16,761 34,489 

Agency Percentage of Total Annual Nondefense R&D Funding 

1955 13.4 12,6 1.8 60.9 8.0 12.6 100 

I960 6,8 17.4 4.1 41.4 20.1 10.3 00 

1965 2.9 11.1 2.4 15.8 63.1 4.2 100 

1970 3.5 15.3 3.6 16.9 47.6 11.5 100 

1975 4.2 23.9 5.9 20.4 30.6 15.0 100 

1980 ' 4.4 24.1 5.6 30.3 20.6 16.0 100 

1985 5.1 29.5 7.2 26.7 17.9 13.5 100 

1988 4.6 30.3 8.2 24.0 21.7 11.1 100 

KEY- USOA-U,S. D«parlm«fil of Agricullufi; HHS-U.S. D«partm«n1 of HMlth and Human S«rv)o»»; NSF-Natlonal Sd«nc« Foundallon; DOE-U.S. 

Departmanl of Enargy; NASA-National Aaronaulloa and Spaca Administration; DOD-U.S. Daparlmant of Dafanaa. 
NOTE: Totals ara not axacl dua to rounding. 

SOURCE: National Ra»aarc»i Council. Invttting In R»s»arch: A Proposal to Stnngthan ffia AgrtcuHunl, Food, end Envirocmtntai Syatm (Washington. DC: 
National Acadamy Prau. 1989), tabia A.I. p. 96. 

national research program. There are about 30 NPS industry, acadcmia, and regulatory agencies. Be- 

employees with expertise in a discipline, commod- cause program areas often overlap, NPS works 

ity, or problem. Their role is individually and together in planning for the entire research program, 

collectively to plan research programs, set priorities, NPS, therefore, is very centralized and not only docs 

allocate resources, review and evaluate research planning and priority setting, but also makes alloca- 

progress, and provide coordination. tion decisions and performs program reviews. 

ARS has a long-range Program Plan— designed in Cooperative State Research Service (CSRS) 
the 1980s — and an Implementation Plan, which 

describe how the Program Plan is to be operated over CSRS is USDA's . . pnncipal entree mto the 
a 6-year period. The Program Plan focuses on the university system of the United States for the 
goals, objectives, and broad research approaches purpose of conducting agricultural research, t 
that ARS will pursue. The current Implementation **. ■ ■ participates in a nationwide system of agncul- 
Plan covers 1986 through 1992 and considers, tural research program plannmg and coordmation 
among other things, how the budget and shifts in among the State institutions, USDA, and the agncul- 
research needs relate to the goals and mission of the tural industry of Amcrica."29 Programs of research 
agency. This strategic planning is relatively new, are jointly developed with the State Agricultural 
having started in 1983. Administrators of NPS feel Experiment Stations, forestry schools, 1890 Land- 
that the development of the Implementation Plan has Grant Universities, and other cooperatmg mstitu- 
enabled them to set priorities, helped in redirection tions. The most recent plannmg exercise resulted m 
of funds, and has increased communication between the strategic plan entitled ' • A Research Agenda for 
ARS and groups such as other USDA agencies, the 1990s." This is the first time that such a strategic 
Congress, user groups, and sciemists. Plan has been developed. It outlines current research 

efforts and areas of proposed enhancement, mclud- 

Tlie Implementation Plan was put together by ing the safety and stability of consumer foods, and 

NPS and the ARS laboratories with input from the protection of water quality. 

»Coopcrativc State Retcirch Service, ' 'Budgci .SubmJwion for 1 990, ' ' hearing before the HouK SubcommiUee on Rural Development, Agriculture, 
and Related Ageociet Appropriations of tbe Conunittee on Appropriations, Part 2, p. 444, 1989. 
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Photo cfMlV; as. O^twtmmt ofAgrMturm 



An Agricultural Resaarcli Service scientist (rear) and a 
graduate student (front) transplant seecOess grape 
varieties. Research and education are intertwined 
in niany research areas. 

The majority of CSRS Federal funds (approxi- 
mately $200 million out of the $340 million in fiscal 
year 1989) comprise formula funds, which are 
directly appropriated by specific acts of Congress. 
Special Research Grants amount to another $61 
million (fiscal year 1989), and consist mostly of line 
item appropriations (which many liken to earmarks) 
requiring oversight from CSRS. Priority setting is 
negotiated between the cooperating institutions and 
CSRS. In addition, the Competitive Research Grants 
Office (CRGO) conducts a nationwide competition 
for basic research funds in specific fields. CRGO 
began in 1978 with programs in plant science and 
nutrition and, by 1985, it had expanded to include 
animal and biotechnology research. NRC, with 
strong support from USD A, has proposed a National 



Agriculture Research Initiative, which would en- 
large the USDA Grants Program from $45 million to 
over $500 million. The program would increase 
research funds in areas not presently supported at 
USDA, such as global climate change.^ 

Forest Service 

The research mission of the Forest Service is to 
'\ . . serve society by developing and communicat- 
ing scientific information and technology needed to 
protect, managei and use the renewable natural 
resources of the Nation's 1.6 billion acres of forest 
and related range lands/'^^ Within the structure of 
USDA, the Forest Service is quite separate from 
CSRS and ARS, as it reports to the Office of the 
Assistant Secretary for Natural Resources and Envi- 
ronment rather than the Assistant Secretary for 
Science and Education. Furthermore, its budget is 
not considered by the congressional agriculture 
committees in Congress, but by the interior commit- 
tees.32 

The decentralized nature of the Forest Service 
research work force encourages bottom-up plan- 
ning.^^ Recently the Forest Service stations have 
been required to submit budgets at four different 
fund-j.^: icvels, ranging from 90 percent of the 
funding level 2 years before to 10 percent over the 
agency request from the prior year. An iterative 
process between Washington and the stations ad- 
justs what work will be done at different budget 
levels. Perhaps the most important trend is that in the 
early 1980s, and before, the budget process was 
tightly controlled by the Deputy Chief for Forestry 
Research. Now the process is much more open, and 
the stations are more responsive to national prob- 
lems, such as global change, water quality, and 
endangered species. For instance, the percentage of 
funding devoted to national problems rose from 28 
percent in fiscal year 1989 to 42 percent in the fiscal 
year 1991 Presidential request, with new develop- 
ments funded as special initiatives. 



*^Scc u s. Dcpartmcni of AgricuHurc, Cooperative Slate Research Service. National Research Initiative Competitive Grams Program: Program 
Description (Washington, DC: 1990). 

i'Sec U.S. Department of Agriculture, •*Slratr??y for the *90s for USDA Forest Service Research,** review copy. Fcbrwy 1990. 

^^Tlie Forest Service has eight regional Rescai .h Stations and the Forest Products Laboratory (FPL) vv^hcre research Is conducted. Within the 8 stations 
and FPL. 190 Research Work Uniu (RWUs) arc gathered at 74 locations. Over 700 scientists work In these units with a total budget of nearly $1.^0 
million. Extramural research is supported at a low levei--tpproximately $14 million per year, although this is deceptive since many of the RWUa are 
lo<;ated on college campuses. 

^Hn pmctice. Research Work Unit Descriptions (R WUDs) charter work in a particular problem area. They usually prescribe a plan for a 5-year duration 
and often wiU build directly on previous work. The Station Director has a large anwuni of discretion to choose projects at Uie RWU level, and the RWUDs 
are reviewed tnhouse in the Washington Office to provide balance in a nationally coordinated program. 



ERLC 



125 



116 ^ Federally Funded Research: Decisions (or a Decade 



OTA found in this and earlier studies that 
investment in research at USDA has lagged behind 
other agencies, and that USDA has difficulty in 
clearly stating its mission, planning for the future, or 
setting priorities in research,^ Consequently, much 
of the new agriculture-related science (e.g., biotech- 
nology) is performed by scientists who are not 
trained in the agricultural sciences and who do not 
pursue agricultural problems. Many blame the lack 
of growth in research funding at the agency to the 
lack of a comprehensive strategic plan.^^ 

Other Agencies 

The six agencies described above together devote 
over $11 billion annually to basic research. Also 
contributing to the research base, but on a much 
smaller scale, are the following 10 agencies: the 
Alcohol, Drug Abuse, and Mental Health Adminis- 
tration (in HHS); the U.S. Geological Survey (in the 
Department of the Interior); the Smithsonian Instim- 
tion; the Environmental Protection Agency; the 
National Institute of Standards and Tbchnology and 
the National Oceanic and Atmospheric Administra- 
tion (both in the Department of Commerce); the 
Department of Veterans Affairs; the Department of 
Education; the Agency for International Develop- 
ment (in the Department of State); and the Depart- 
ment of Transportation. This group of 10 agencies 
represents approximately 5 percent of the total 
Federal expenditure on basic research.^^ Although 
their contribution is comparatively small, these 
agencies lend breadth and flexibility to the Nation*s 
research capacity. 

Crosscutting Descriptions of Agency 
Priority Setting 

Comparisons of the research agencies reveal the 
variation and complexity in the Federal research 
system. While agency cultures are very different, the 
prospect of transferring methods and standards 
across agency boundaries deserves consideration. 



OTA fu^t examines various characteristics of the 
organization and management of the Federal re- 
search system. 

Division of Labor 

The Federal research system can be thought of as 
a composite of the various agencies that support 
research. Each agency has a mission and therefore a 
purview of research responsibility* NSF and NIH^ 
for example, have the broadest scope in research 
areas funded. Any project within a discipline that is 
of high quality and does not clearly fall under any 
other agency's jurisdiction can be a candidate for 
funds. 

NASA, DOE, DOD, and USDA have more 
restrictions (than NIH or NSF) on the research areas 
that they support. NASA supports science that can 
make use of space (and most often seeks information 
about space), either through satellites, experiments 
above the atmosphere, or human exposure to zero 
gravity. DOE funds research relating to nuclear 
weapons and all forms of energy and its effects on 
humans and the environment, which is interpreted 
broadly in the Department. 

Although some claim that because the research 
areas supported by DOD and USDA are closely tied 
to their technical missions, the research by defmition 
caimot be basic or fundamental in nature. Indeed* 
OTA finds that the research supported by these 
agencies can be as fundamental as that supported by 
other agencies, such as NIH or NSF. In addition, the 
amount of funds spent on basic research at these 
agencies is comparable in size to that disbursed by 
NSF. Nonetheless, these agencies' priorities shape 
research goals. 

Areas of support among the agencies allow a 
multitude of questions to be posed and investigated 
differently within the research system. This also 
provides some measure of pluralism in research 
opportunities, i.e., many researchers have two or 
three agencies (and even more programs) within the 



^U.S. Congress. Office of "ftchnology AsKSsmcni. Af^ricultural Research and Technology Transfer Policies for the J 990s, special report. 
OTA-F-448 (Washington, DC. U S. Govcmmcnl Prinung Office. March 1990). 

"Ibid. 

^All budgcl d3U reported below are based on NalionaJ Science FoundaUoo. Division of Science Resources Studies, Federal Funds for Research and 
Development Detailed Historical Tables, Fiscal Years 1955^1990 (Washington, DC: 1990); and National Science Foundaiion. SelectedData on Federal 
Ftinds for Research and Development Fiscal Years 1990, and 1991 (Wasliington, DC: December 1990). 

''^Researchers quickly Icaru what research is and is noi ehgible for funding al an agency. Program announcement, conversations with program officers, 
and the fate of other fubmiited proposals convey lo the researcher which agency (and program wiihin it) is an appropriate source of funding. This. too. 
is part of the agency culture, which forms a constituency of extramural research performers. 
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Federal Government to apply for funds. Pluralism 
has long been hailed by the scientific community as 
a strength of the research system in the United 
States.^^ However, the pursuit of agency missions is 
not without legislative contention, as Congress 
consistently asks agency managers, in authorization 
and appropriations hearings, how specific research 
programs support the agency mission. 

Coordination 

The division of labor among the agencies does not 
seek to eliminate overlap; indeed, agencies cooper- 
ate to fund some areas of mutual interest. Agencies 
with broad research agendas, such as NSF and NIH, 
coordinate more routinely with other agencies — 
more than those, such as USDA, with a more nanow 
scope. 

In addition, because of the size of agencies and 
departments, coordination within the agency or 
department can be important as well. For example, 
the services in DOD sometimes attempt to fmd a 
niche in a scientific area so there is no overlap witli 
another service. In supercomputers or artificial 
intelligence, for instance, the Air Force has chosen 
to rely on the other services. The Air Force in turn 
takes the lead in other areas, such as mathematical 
control theory. In areas that require overlap, how- 
ever, agency wide conmiittces are often employed to 
coordinate the activities of the services, DARPA, 
and SDIO.^Q 

Coordination among and within Federal agencies 
occurs at two levels, at the agency program level and 
at the research performer level. Agency-level coor- 
dination generally occurs through committees. One 
standing coordinatmg mechanism is the Federal 
C-^ordinating Council on Science, Engineering, and 
" jclmology in the Office of Science and Tfechnology 
i'olicy. It has several subcommittees, such as Global 
Change and High-Performance Computing, which 
provide a forum in which agencies can communicate 



(see chapter 5). Other committees that are not 
govemmentwide also exist, which may coordinate 
two or more agencies on a specific topic. 

Researcher and program manager level coordina- 
tion occurs through meetings and other communica- 
tion that is a normal part of the discourse of the 
scientific community. It is at this level that the 
separate roles of agencies are most apparent and that 
researchers accommodate to changing funding lev- 
els in the cooperating agencies. An illustration of 
agency and performer interpc^ion can be found in 
superconductivity research (see box 4-C). 

Bottom-Up and Top-Down Management, 
and the Use of External Advice 

One of the most prevalent styles of management 
of research has been loosely titled bottom up, which 
implies that research ideas and priorities originate 
with researchers who communicate these ideas to 
their sponsors (agency program managers, for exam- 
ple). These managers in turn talk to their superiors. 
As ideas percolate, their relative importance is set. 
Bottom-up management contrasts with top-down 
management, where the most senior decisionmakers 
in an agency decide the priorities for the system, or 
their part of it. These directives are then transmitted 
down the organizational ladder in consultation with 
managers, eventually to researchers. 

OTA fmds that in the research agencies both kinds 
of management are prevalent and are often mixed. In 
short, decisionmaking is more complicated. Some 
agencies employ much stronger top-down direction. 
In the Agricultural Research Service of USDA, 
priorities are set by the National Program Staff, and 
at DOD, managers at all levels exert a great deal of 
influence over the areas in which they support 
projects. On the other hand, agencies such as NSF 
and NIH employ mostly bottom-up management. At 
NSF, this means that only priorities among areas of 
support are set at the top (by the Director, the 
Assistant Directors, and NSB). For example, deci- 



^As Hunter Duprec observed : * * A plural $e! of govenuneni agencies weni lo a plural sei of congressional committees to ask for appropriations, which 
were then distributed by grant and conlmci to Investigators in a plural set of universities.'* Quoted in U.S. Congress, House Conmiittce on Science and 
Tfechnology. Thsk Force on Science Policy. A History of Science Policy in the United States, i940-J9S5, 99th Cong. (Washington, DC: U.S. Government 
Printing Office. September 1986). p. 40. 

^'Overlap in support responsibility among agencies for certain areas of research ensures belter diffusion of results into multiple appUcations. a kind 
of inadvertent diffusion policy. Harvey Brooks. Harvard University, personal communication, February 1991. 

^'A very good example is the Joint Services Electronics Program, operated continuously since 1945. in about 20 or so universities. The three military 
services provide equal contribtitions to each univenity group, but delegate administration to one service. For example. Harvard University and the 
Massachusetts Institute of Ttchnology each have such a program admmistered by the Office of Naval Research. This is a fairly successful 
interdisciplinary program. Ibid. 
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Box 4-C-^oordination of Superconductivity R&D 



Major research initiatives are usually executed by one Federal agency, based on the scope of the research and 
the mission of that agency. There are exceptions* of course, where research on one area is done in several different 
agencies, and these research areas bring with them the added burden of coordination. In the case of 
superc<mductivity, coordination becomes especially important sfaKe research is spread among several different 
agencies, primarily the Departments of Defense (DOD), Energy (DOE), and Commerce, the National Science 
Foundation, and the National Aeronautics and Space Administration (NASA).^ 

There arc two aspects of coordination that require quite different approaches. First, coordination is required 
to monitor the different programs and make appropriate decisions to ensure an efficient allocation of research funds 
to all of the agencies. Second, at the researcher and program level, there must be an adequate flow of Infomiation 
between researchers to avoid overlap or duplication of research. Effective coordinaticm at both the national level 
and the researcher level is vital to a successful research program. 

Congress has made several anempts to encourage coordination of superconductivity research and development 
by the executive branch. Part of the 1988 Omnibus Trade and Competitiveness Act created the National 
Commission on Superconductivity (NCS) which was to meet, produce a repcMt, and then dissolve by December 
1 989. The Trade Act also mandated an increase in staff for the National Critical Materials Council (NCMC), which 
at the time had no active members. Finally, the National Superconductivity and Competitiveness Act of 1988 called 
for cooperation between the Office of Science and Itehnology Policy (OSTP), NCMC, and NCS in order to produce 
a 5-year National Action Plan for Superconductivity to be accompanied by annual repcHts. 

Ttie success of these initiatives has been limited. The 5-year National Action Plan was published in Decembo- 
of 1989, but the fomiation of NCS was delayed, so it did not talce pait in the plan's formation. Although che plan 
itself acknowledged the need for better Federal coordination, it lacked both the budget recommendations and the 
long-term perspective Congress had requested.^ In addition, the Federal Coordinating Council on Science, 
Engineering, and Ibchnology Committee on Superconductivity report of March 1989 did little more than assemble 
agency superconductivity budget data and list various programs.^ 

Fominately, at the researcher and ag^cy program level, the exchange of information has successfully 
protected superc(Hiductivity research from overlap and duplication. Programs at different Federal aggies have 
aided scientists in the exchange of research information, if not actual coordinaticm of effort. The Ames laboratory 
distributes the *'High-Tc Update,** a widely read newsletter; the national laboratories have broadcast nationally 
several high-temperature superconductivity conferences; and DOB has established a computer database that shares 
research results with industry. NASA aJso maintains communication through the Space Systems Ibchnical 
Advisory Comminee, a group with^representatives from industry, universities, and government organizations. 

The success of the ground-level coordination efforts is promising, but the resistance to priority sening from 
u\c administration may inhibit the progress of superconductivity research. In particular, such questions as whether 
DOD funds too high a percentage of superconductivity research, and whether the Federal laboratories are doing too 
much of the research relative to other performers are important to the fiinire success of the development of 
superconductivity. These questi(His must be addressed through agency-level coordination. 



^Puodifig levels At e«cb agency, of coune, are t separtte Mid pertuips more preisliig issue. See Kim A. McDoiudd, * 'Fuiel Urges Increased 
Support for Superconductivity. Recommends Specific Goals for Research in Field/ ' Tht Chronich ofHi^htr Education, vol. 36. No. 48, Aug. 
15. 1990. pp. A5. AT 

^U.S. Congress. Office of Ibchoology Assessmem, High*Ttmptrature Superconductivity in Persptctive, OTA-E-440 (Washiogtoa, DC: 
U.S. GovenmieDt Printing Office, April 1990). p. 63. 



^Ibid.. p. 69. 



sions arc made to support the physics program at one 
ti'iiding level ;uui the chemistry program at another, 
Hollom-up rnanagetnent at NSF ;uk1 NIH leads to a 
different selection mentality than that in other 
agencies, speciTically to reliiuice on peer review as 
a formal mechanism lor inci)rporaling advice from 
the scjenlilic community. 



Agencies that are more t>ottom up also tend to 
employ more piuiels or to commission more studies 
from outside of the agency to help set priorities. At 
NSF. NIH. and NASA, .stmiding external commit- 
tees. NAS. the National Academy of E^nginecring, 
and the Institute of Medicine play significant roles 
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such as DOE, USDA, and DOD employ outside 
panels to assist in determining research directions to 
a lesser extent. 

Another difference between top-down and bot- 
tom-up management is the degree to which the 
agency becomes invested in the success or failure of 
a project. For example, DOD has a large operational 
investment in the results of the research it supports. 
This provides an atmosphere that reminds research- 
ers that DOD has a stake in their success. Conse- 
quently, these researchers report favorably that DOD 
is more realistic about the funds and time needed to 
complete a project, and program managers are more 
available during the course of the project to aid with 
difficulties that may arise.^' This contrasts with the 
experience of NSF and NIH researchers where the 
agency does not have a stake in the success of any 
one project, because there is no expectation of direct 
*'use'* and no timetable for making '^progress/' 

Intramural and Extramural Research 

Five of the agencies that OTA studied support 
intramural research (NIH, DOE, DOD, NASA, and 
USDA). Intramural research facilities are most often 
within laboratories either run directly by the agency 
or by an outside contractor Together tlie Federal 
research agencies are the primary sponsors of 
hundreds of laboratories. Some are administered 
directly by the Federal Government, such as 
NASA's Goddard Space Flight Center, while others 
are administered by a university or corporation, such 
as DOE's national laboratories. Laboratories can be 
funded institutionally, where monies flow from the 
research agency to support ail activities at the 
laboratory, or industrially, where the laboratory 
competes with other laboratories and research or- 
ganizations to perform research for clients in number 
of research agencies. Often there is a mixture 
between institutional and industrial support within a 
laboratory, as in many of tiie DOE national laborato- 
ries. 

Intramural Research 

Research in intramural laboratories has many 
distinct advantages for the Federal Government. 




PtwfQ Cfdt: U.& t)0ptirtin0nt of Eimgy 



Los Alamos National Laboratory (LANL) Is one of the oldest 
Intramural laboratories of the Department of Energy. LANL 
was established In 1 043 to develop \Aforkl W^r II atomic 
bombs, and today retains responsibility for oonducting 
defense-related research progranm. Research at LANL 
has also diversified Into other fields such as fossil 
and geothermal energy. 

First, laboratories can maintain a research effort over 
one or more decades. Second, laboratories can easily 
incorporate a multidisciplinary approach to prob- 
lems. Third, DOE managers report that they more 
often f\ind **risky** research — research that has a 
very good chance of abject failure, but also a good 
chance of resounding success — at the laboratories, 
because the laboratories can absorb a setback 
without jeopardizing graduate students or young 
faculty. Fourth, project managers can easily main- 
tain their involvement in the projects at a laboratory. 
Fifth, the research at the laboratories can be put ''on 
the fast track,** in the words of one manager, when 
the results are needed on a timetable. Sixth, there is 
ample evidence that the laboratories can often 
perform research at a reduced cost to that performed 
extramurally. Finally, the laboratories are often the 
only sensible place to site facilities needed for a 
project, because access and maintenance can l>e 
assured.^^ 

Disadvantages of intramural research include 
problems in recruiting and retaining personnel. The 



^'This suggests that dUfacuccs in project ax>Qitohfig luore or less crente the need for ex post accountAbility — tod the caU for evikluiulon of project 
outcomes (see ch. 8). 

^^This aJso makes laboratories important sites of science education. The role of tutsxion agencies aiKl their laboratories in scierkce education has grown 
noticeably, especially at the Department of Energy. See U.S. Congress. House Committee on Science. Space, and Ifcchnology, Subcommittee on F^iergy 
Research and Development. RoU of the Department of Energy* s National Laboratories in Science, Engineering and Mathematics Education. 101 st Cong. 
(Washington, DC: U.S. Government Printing Office, June 13. 1990). 
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government laboratories must pay on the Federal, 
pay scale, but while salaries have risen in academia 
and industry for scientists, growth in salaries in the 
Federal Government has been very slow/^ Conse- 
quently, although research problems addressed at 
the laboratories and the research environment can be 
very exciting, researchers are often attracted by 
much higher paying and more flexible jobs else- 
where.^ Some critics claim that the pay scale and 
government cutbacks have limited the quantity and 
quality of research in the Federal laboratories/^ In 
addition, intramural laboratories often do not sup- 
port graduate students, which are an invigorating 
part of research. 

Another disadvantage is that many laboratories 
are large organizations. While they were built with 
a mission (or a set of missions) in mind, the mission 
may have been achieved or abandoned.^ The 
laboratory must then find a new mission or face the 
prospect of downsizing or phaseout. Laboratories 
have sometimes moved from mission to mission, but 
this can lead to great stress in the organization.^'' 



Extramural Research 

The advantages of extramural research include 
competition on the **open market" for the best 
research teams for a particular problem. (Note that 
laboratory teams can often compete for these funds 
as well.) Extramural researchers are paid competi- 
tively and can be solicited for one project. The 
research performers are top scientists in an area and 
enjoy access to state-of-the-art equipment. 



Disadvantages of relying on extramural research 
are, first, that extramural researchers must bid for the 
project. If a new project is not associated with 
enough gain (either in money, equipment, or publi- 
cations), it is difficult to find extramural researchers 
willing to apply (although this may also be true in 
some cases for intramural laboratories).^ In acade- 
mia, government-sponsored research is also con- 
strained by the academic environment. For example, 
although DARPA fUnds university research, on 
some projects DARPA finds it difficult to work 
solely with universities. TTie university stmcture of 
research, with a professor and his or her graduate 
students, often operates too slowly for DARPA's 
purposes. Also, DARPA reserves the right to tcmu- 
nate at any point, which can be disastrous for a 
professor and especially for a graduate student. 

OTA finds that both intramural and extramural 
capabilities are important for lae advantages they 
provide the agencies; both should be supported by 
the Federal Government.^' At present roughly one- 
quarter of all research funds are spent intramurally, 
slightly under one-half extramurally in universities 
or colleges, one-quarter in industry, and one- 
twentieth by other performers.^^ 

Issues of Agency Priority Setting 

Some priority-setting issues are of particular 
concern across all of the research agencies. OTA 
identifies four in particular: 1) risk-taking and 
conservatism, 2) flexibility, 3) strategic planning, 
and 4) redirecting the agencies. 



U S . Depaitrocni of Conuncrcc. Bureau of Economic Analysis Govcmmcni Division. ' ' Biomedical Research and Development Price Index** ' report 
lo ihc NalionaJ Instilules of HcaJlh. Mar. 30. 1990. 

^Pepper Ixcpcr. "NIH Intramural Program: No Radical Changes Su4cd,** Report of the National Research Council, December 1988- January 
1989. pp. 2-5. 

*^For example, set Kne/o. op. cit.. foouiote 9. p. 38. Similar siatemctJl5 were mi<k» in several OTA InJervicws it the research agencies. 

^''Aho, big labs lend to become bureaucratized a5 Federal pay policy leads to « gerontocracy, with tlie least entrepreneurial people slaying on. A 
big disadvantage of inu^amural research is that it is much easier to do relatively 'bormg' but vitally useful research, e.g.. ipcclroicopic tables, and 
.systematic physical and chemical property measurements." Broolcj. op. cit., footnote 39. 

*^Evidence of ferment has been most apparent at the Dcpartmcm of Energy. See Council on Competitivenesi. * 'National Labs Meet With DOEt*' 
Ugislaiivf and Policy Update, vol. 3. No. 2. Jan. 28. 1991; Mark Crawford. •'Domemci Bill to Broaden Uba' Mission*/* The Energy Daily, vol 19, 
No. 14. Jan. 22. 199Lpp 1-2; and "Roundlable: New Challenge.-s for the National Labs.*' Physics Today, February 1991. pp. 24-35. 

^Ttiis problem could be compf)undcd by the recent Bush Administration proposal lo charge users of Federal facilities, such u Broofchaven National 
Uboratory's synchrolmn light source, a fee lo cover opc.aung costs. See Mark Crawford. '•Researched Protest User Fees at NautMial Labs." Science, 
vol. 251. Mar. 1. 1991. p. 1016. 

^^In response to outside panel rccommendadons. three agencies with substantial inhouse rc«carch~ihe Dcparmient of Agriculture, the National 
Oceanic and Atmospheric Administration, and the Envlronmenul Protection Agency— are seeking to expand their extramural programs, if Congress 
approves. Sec Elizabeth Pemusi. "New Policies ai Tliree Federal Agencies Und More Support to Outside Reaearch»" The Scientisu vol. 5, No. 2, Jan. 
21, 1991. pp. 3,5. 

»See Beite HilerriAo. * 'Fuels axid Figures for Cbeuucal RAD." Chemcai St Engineering News, vol. 68. No. 34. Aug. 20. 1990. pp. 28-30. 
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Risk-Taking and Conservatism 

Agency cultures promote differences in the kinds 
of projects selected for funding. In particular, 
agencies differ to a large extent in the amount of 
risk-taking in research that they encourage in 
scientific programs and by research managers. 
Risk-taking can be defined in a number of ways. 
Perhaps most important is that risky research is not 
considered in the mainstream, no specific outcome 
of the project is assured, and a large chance of failure 
exists (i.e., of not reaching the objectives set out in 
the proposal). However, the definition of risky 
research changes depending on the agency and field 
of inquiry , and to some extent, every research project 
is inherently **risky." 

Within agency cultures some programs can as- 
sume more risks, because in the pursuit of a specific 
objective it is often wise to try some conservative, 
yet slower means, along with more experimental, 
less certain paths that might yield large payoffs. 
DOD claims to take the most risks in the course of 
its research prognun. DOD expects that most basic 
research will not attain the results that it originally 
proposed. Within the 6.1 category, DOD research 
miuiagers assume that less than 30 percent of ihe 
projects will succeed; within 6.2, roughly 30 to 60 
percent; ;uid, within 6.3A, roughly 60 to 90 percent. 
Supporting unsuccessful projects is viewed a.s piu*l 
of the business of finding projects that do pay off.^* 

In contrast, when there is no defined goal, how i.s 
risk defined — pr()f)osals tliat earn diverse ratings 
from peer reviewers? that are submitted by re- 
sciu-chers with no track record? or that appear to be 
of margifial interest to the pju-ticuhu* prognun 
weighing its merits? Attributes of risk are not clear 
cut. FurthcM , the pace and impact of results emerging 
from federally funded reseiych projects \\rc no guide 
to their ••riskiness," judged retrospectively. 

Yet NSF ajul NIH managers claim that 90 jxjrccnt 
or nuire of the projects thai the agencies support are 
••successful/* Success in the NSF mid NIH context 
may mcim that refcreed publications were produced 
from the project. This satisfies the criterion of 
adding to the archive of knowledge, without nieitsur- 
ing how that research was received by the commu- 
nity.'^^ NSF has recognized a need to support more 



''high-risk*' projects, instituting the Small Grants 
for Exploratory Research program to engender more 
risk-taking (see box 4-D). 

Since it is obvious that not all scientific advances 
are made through slowly evolving research (epito- 
mized by DOE's fusion energy program), but often 
with new and exciting projects, it is important for 
each Federal agency (and probably most research 
programs within it) to support both kinds of projects. 
This point is recognized by the scientitic community 
when it simultaneously urges funds for new avenues 
of science as well as for the ^'science base/* by 
which is meant the protection of evolutionary (and 
usually individual investigator, small team) re- 
search. While DOD addresses risk-taking through 
expectations for project outcomes and NSF has 
created a separate program, most agencies rely on 
program manager discretion to incorporate risk- 
taking. As priorities are set in new areas, it is very 
important to continue, and even augment, risk- 
taking in individual investigator research, and agen- 
cies should be encouraged to increase their efforts to 
fund risky projects. 

Flexibility 

When new priorities are introduced at a research 
agency, it must be flexible enough to reorient and 
develop relevant programs. Flexibility can be de- 
fined in a number of ways. But the most critical 
aspect of flexibility for funding scenarios in the 
Federal Government is the ability to make tradeoffs 
iunong scientific programs and to pursue growth by 
substitution — to start and stop programs, and to 
encourage new ideas without allowing fiscal con- 
straints to hinder (or undcmiine altogether) their 
pursuit. 

At the program level, flexibility is already pro- 
vided in several ways. First, many agencies budget 
di.scretionary monies for managers to pursue new 
ideas. For example, some agencies (e.g., the Office 
of Naval Research) divide their pools of money into 
**core*' and * 'accelerated*' research initiatives. Core 
prognuns maintain expertise in certain areas and rely 
on principal investigators to propose goals for their 
research. Accelerated initiatives allow significant 
amounts of money to be quickly infused into a 
specific project area. Second, programs that disburse 



Iticsc riKUffs arc a toascn'iu.s among !Jm» Dcpaitnicn! of Dcfenxc nwrugcrs wlumi OTA inicrvicwcd 

I'of ciartiplr. sec Malcolm Oladwcll. "Arc Nuhcl Piu.cs for U S VeMigcs of 'Golden Age*?" Th€ Washinftion Posi. Nov. 16. 1990. p. A6. 
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Box Small Grants for Exploratory Research 



Risk-taking is an important part of scientific research. In panicular, the rate of scientific advancement 
witnessed this century could not have been achieved had the Nation not invested in some high-risk research along 
the way. However, the National Science Foundation (NSF) has been criticized that its funding decisions, based on 
a system of external peer review system, has become too conservative.' In response, NSF instituted in 1989 the 
Small Grants for Exploratory Research (SOER) program, which funds only small, high-risk research projects. In 
the words of a former NSF assistant director, who spearheaded the pilot program that led to SGER: * 'With the small 
amount of money, relatively, that NSF can give out, we cannot take care of all research needs. On the other hand, 
we have sufficient amounts of money to stimulate more creative and innovative research by playing a catalytic 
role. "2 

SGER grants are funded differently from ordinary NSF grants in several important ways. TTie definitive 
difference is that SGIiR grants go exclusively to researchers who are exploring ''novel ideas** or "emerging 
research areas. ^^-^ In addition, NSF eliminated formal, external peer review. Final recommendations on funding are 
left entirely up to the program manager, although the manager may certainly seek as much advice as he or she 
desires. More than in other NSF programs, grant applicants are encouraged to discuss their proposals with the project 
manager before submitting them in order to ascertain the proposal's chance for success. This reduces the number 
of unsuccessful proposals submitted, thus increasing the efficiency of the process and saving time. Also, this 
practice helps to foster a favorable working relationship between the researcher and the program manager. However, 
critics fear that this interaction might . . work against faculty who are not comfortable with selling themselves 
to others.*** 

Processing speed is another important Hspect of the SGER program, as high-risk research often implies 
fast-paced. SGER grants are limited to $50,000, and tlie duration is no more than 2 years, usually only 1. Keeping 
grants on this smaller scale can make them easier to process. 

In 1990, NSF funded 244 SGER proposals (while declining 210) at an average award of $34,254.^ Also 
encouraging is the amount of activity in divisions, such as the biological sciences and Earth sciences, where the 
SGER program is being instituted for the first time.* The SGER program appears to provide an outlet for NSF to 
fund cutting-edge, high-risk research that the traditional NSF peer review system might not be equipped or inclined 
to support. 'Hie genre most served seems to be '*cross-disciplinary** research, such as studies of natural disasters.^ 
In addition, an Expedited Awards for Novel Rese^irch program (forerunner of SGER) survey of recipients foimd 
that 90 percent of SGER-funded researchers go on to apply for a regular NSF grant.** 

SGER program spending is limited to 5 percent of each program. However, it appears to provide access to NSF 
funding for new researchers and, as one researcher put it, SGER support might result in ' * . . . fewer publications per 
dollar, but more chances for qmuitum leaps in advancing science.**"^ 



Mlic Natioruil SclerKrc F'oundation's own survey of 1 4,000 appliconis wtio tiad been awardetl or declined funding during fiscal year 1985 
found Ihal iwo oul of three iigrced with ihis slaierncnt: '*NSF is no» likely io fund high-risk exploratory research because ihc likeliho<xl of 
obtaining favorable reviews is slim." See National Scicim:c Foiindalion, Frognuu Evaluation Slaff. Proposal Review at NSF' Perceptions of 
Pnnapal Investii^ators. NSF 88-4 OVashington. DC: Fcbmary 1988). p. 18. 

^Natn Suh quoted in David Bjerklie. *'Fast-Track CJmnti.** Technology Heview, vol. 93. No 6. August/Scpleuibcr 1990. p 19. 

'^Wtiai folluw.s. unlcsii otiierwise irulicated. is based on National Science Foundation. Small GranU for Exploratory Research brochure^ 

1989. 

^Janies M. McCullough. director. Frograin livaluaiion St«if!. National Science Foundation, * 'Responses to Bulletin Board Message About 
yuick-Rcsponse. Non-Revicwc<l Gmnts/' Mar. 10. 1989, p. 5. 

^Preliminary statistics on Ibc Snull Grtnts for Exploratoiy Research program provided by James McCullough, diivctor, IHograin 
Bvaluation Staff, NatioiuiJ Science Foun<Ution« personal conimunicaiion« Jan. 23. 1990. 

^National Science F^oundation. unpublished dau. Aug. 8. 1990. 

^TUc fate of such proposals at the National Scinice Foundation, at least before the scope of the Engineering Directorate wa^ enlarged, 
wan problcmaiic Sec Alan L Porter and Frederick A. Rossini. *'Pccr Rcvit*w of Interdisciplinary Research ProposuLs.'* Science, Technology, 
& Human Values, vol. 10. No 3. summa 1985. pp. 33^8. 

'^Investigators witlioul prior National ScieiKe FourKlation support are eitcouraged to apply to the Small Orant.s for Explorulory Research 
program, and the program indeed seems to attract many first-time applicants. Sec Ujcrklic. op. cit.. footnote 2, p. 19 
9Respon.ses to McCullougli, op cit . foonwle 4. p 7 
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money by manager discretion have inherent flexibil- 
ity. Specifically, program managers have the ability 
to continue or disband a research project, whereas in 
competitive peer reviewed grant programs many 
more persons — the ad hoc or standing peer review 
panel and the program manager — are asked to 
concur on a specific decision. Finally, in some 
programs, such as the Office of Space Science and 
Applications at NASA, managers are allowed some 
{)ortion of their budget as discretionary. Discretion- 
ary money is important to foster new ideas witliin a 
* 'zero-sum" climate where money spent on one 
research project detracts from another. 

Agencywide tradeoffs in budgeting luid resource 
allocation are very important, but once a program 
has been initiated it is hard to end. This nappens for 
a number of reasons. First, many p^^ople have 
become invested in working and supporting the 
program. Second, the program's political constitu- 
ency may wish to see it pursued, and may lobby both 
Congress and the agency. Finally and most likely, 
given funding constraints, it may be very difficult to 
start a new progriim. It tends to be easier to redefine 
an old program to meet new goals, though it may not 
be immediately as effective as a completely new 
program. 

OTA finds that agencies and managers throughout 
the Federal research system could be provided with 
tlie means, and perhaps incentives, to be more 
flexible. Ending one program and starting another 
could be made easier. More discretionary money 
could be provided, incentives for managers could be 
increased, and miuiager discretion accompiuiied by 
accountability and attention to success could he 
encouraged. Flexibility to adapt to research develop- 
ments within a chiuiging budget envelope is impera- 
tive. The production of excellence in research mid 
the reduction of stress if funding docs not keep pace 
with demand by the research community must go 
hand-in-hiUid. 

StriUt?gic Planning 

Strategic plans have recently been employed by 
many of the research agencies as m important 
com)X)ncnt of the resciuch {X)rt folio/* ^ These agen- 



cies include the three services in DOD, CSRS in 
USDA, the NSF research programs (through NSB), 
and the Office of Space Science and Applications in 
NASA. While these agencies have always planned 
their near-term activities, many agencies have begun 
to codify the plans and publicly distribute them for 
comment. 

Strategic plans are very useful because they 
communicate within the organization, the Federal 
Government, and the research community the inten- 
tions of the research program over the next 5 to 20 
yeiu-s. They articulate the mission of the research 
investment and outline the steps necessary to attain 
intermediate and long-term goals. The mission may 
be as general as supporting research in a broad area, 
or as specific as solving a particular problem or 
developing the foundation for a specific technology. 
For instance, in the strategic plan for OSSA, NASA 
states that it will attempt to launch a combination of 
small and big satellite missions every year, thus 
showing a commitment to small science missions in 
space. If a program already has a clear idea of its 
mission and the means of attaining its goals, then the 
construction of a strategic plan is relatively easy. If 
that understanding does not exist, then the creation 
of a plan can be very useful in defining and pursuing 
those objectives. 

Often the fonnation of a strategic plan is resiste<l 
within a program for fear of perpetuating relative 
funding differences and forcing decisions prema- 
turely to pursue specific objectives. Judicious and 
regular revision of plans has led to a more realistic 
allocation of funds and allowe<l oversight by tlie 
executive branch and Congress to proceed smootlily. 
Rather thiui arbitrarily freezing the program, its 
I>otential can be highlighted and new options enter- 
tained within and without llie current program 
structure. 

Wliile strategic plans are not the solution to all of 
the problems presented by the chiuiging research 
economy, and can be used to justify decisions rather 
than to improve on tliem, OTA finds that strategic 
iuid contingency plans (especially when accompa- 
nied by ex post evaluation — see chapter 8) are 
elements tliat CiUi be emp'oyc<i by tlie reseaich 



^'IIktc is a school uf though! (to which OTA suhsUntiaJly suhscnJ)cs) (tiai slraicgic plaiw are primarily iwcful for conmiunicatioti and liavc two 
negative polcnlKils I) rhcy may put on the shelf and ignortd. and 2) ihcy may he implemented blindly Strategic planning needs to lie an 
inshtutiofLiliyed ongoing process, and plans need to Jh* working dot iuncnts ikit arc constanlly revise<l so llw; planning hort/on rolls forward. 

^*l*rograjas ;ind agencies within the DepAflinciil of DcfeiLsc. ihc Nalioruil Aeronautics and Space Adnuni.^iration. tlie National Science T'oiindalion, 
iuul tlic V S iHrparimcni of Agriculture luivc rtvcntly proiluced stialcgic plaius. The National Institutes of Health is in the process of developing one. 
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agencies to plan for the future, increase communica- 
tion, and accommodate new and continuing devel- 
opments within the Federal system. 

Redirecting the Agencies and Addressing 
New Problems 

What happens when the current mission of the 
agencies is no longer well formulated or appropri- 
ate? Many agencies have been chastised that their 
mission is either out of date or lost amid a multitude 
of programs. Observers further claim that the 
agencies are calcifying, pursuing programs and 
setting priorities because of tradition rather than 
national necd.^^ 

For example, DOE has bec:^ challenged that it 
does not support research that primarily seeks to 
solve the Nation's energy problems, but instead 
supports a broad array of research programs from 
high-energy colliders to radiation exposure in hu- 
mans. Some claim that these problems would be 
better pursued in an agency like NSF and that DOE 
should concentrate on energy research. In a contrast- 
ing example, USDA has been repeatedly criticized 
for supporting a narrow research agenda. Biotech- 
nology and other fields related to agriculture do not 
easily gain support within the USDA system. Critics 
point out that the USDA system does not coordinate 
well and many research opportunities fall through 
the cracks between ARS, CSRS, the Forest Service, 
and other programs.^^ In a third example, after a 
series of large programs had not lived up to 
expectations (e.g., the Space Shuttle and the Hubble 
Space Iblescope), a Presidential commission was 
created to conduct a comprehensive review of 
NASA priorities and procedures." 

Many agency problems result from Federal at- 
tempts to cope with tighter budgets and setting of 
priorities. OTA fmds that the Federal agencies are 
responsive to changing national needs, but are 
limited by the program stmcture and budget. Agency 
missions were defmed many decades ago, often 



when budgets were expanding, and these mission 
statements were ambitious. Agencies always seek 
growth as an overall objective. But decisionmaking 
structures do not serve as well when tradeoffs 
between agency programs must be made and manag- 
ers have little incentive to terminate programs.^® For 
the research system to thrive in the 1990s, the 
termination of some programs in favor of others may 
be required. 

Some also question whether the scope of many 
agencies' programs should be reduced so that 
whatever they decide to do they can do well. Perhaps 
lessons learned at DARPA are instructive. DARPA 
rarely pursues a problem without the required funds, 
and attempts not to start programs at low levels 
(which implies that the budget must free up to 
accommodate the program sometime in the future). 
DARPA personnel regard this philosophy as crucial 
to their success. 

In summary, aafting goals and missions tor the 
Federal agencies as the research economy changes is 
not just a matter of the scientific objectives, but also 
of management. The agencies were created at 
different times over the last half century and carry 
with them culttu-al traditions and organizational 
structures. As new goals are assigned to the research 
system. Congress and the executive branch must pay 
special attention to the capabilities and decision- 
making mechanisms of each ag.mcy. This includes 
the methods by which priorities are implemented in 
the selection of researchers and projects for support. 
OTA considers these methods next. 

Funding Allocation in the 
Federal Agencies 

When applying for Federal research funds, re- 
searchers submit a proposal. In general, a proposal 
requests support for an individual, a specific project, 
or a center and is submitted to a particular program 
in an agency for review. The process of review can 
be thought of as a continuum of methods ranging 



^^Rcniarlu m "OTA Worlwhop on Costs of Research and Federal Dccisioaniaking," July 9. 1990. 

*^ffice of Ttchnology Asscssmcnr, op. cir.. footnote 34; U.S. Congress, Office of Tfcchnology Assessment, US Invtstment in Biotechnology ^ 
OTA-DA-360 (Wuhlngion, DC: U.S. CJovemment Priming Office. 1988); and U.S. Genera) Accounting OiViQ^.Biouchnology: Analysis of federally 
Funded Research (Washington, DC: U.S. Oovermwent Printing Office, 1986). 

Advisory Committee on the Future of the U.S. Space Program, op. cit.. footnote 18. 

^Indeed they are encouraged to keep programs in operation. See Harvey Averch, "Policy Uses of 'Evaluation of Research' Literature." OlA 
contractor report. July 1990. Available tlirough the National Ibchnical Information Service, see app. F. 

^or a case snidy analysis of Federal mechanisms used to fund university research, see U S. General Accounting Office, University Funding: 
Assessing Federal Funding Mechanisms for University Research, GAO/HCIiD-86-73 (Washington. DC: Fcbmary 1986). 
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from soliciting advice from experts vutside the 
agency, or peer review, to relying solely on the 
judgment of the research officer who must defend 
decisions to award or decline funding; this might be 
called manager discretion. In practice, a mix of 
these methods^ even within the same agency, is 
common. 

Peer Review 

^Teer review'' describes a family of methods 
used to make funding decisions about research 
projects. It usually comprises a multistaged process, 
where reviews of the proposal are solicited from 
experts in the scientific subdiscipline of the pro- 
posal. Reviewers are most often asked about the 
technical excellence of the proposal, the competence 
of the researchers, and the potential impact of the 
proposed project results on a scientific discipline or 
interdisciplinary research area. Peers may also be 
asked about the project's relevance to the objectives 
of the funding program. The proposals and reviews 
may then be considered by a panel of experts, and 
competing proposals compared. The panel even- 
tually ranks the proposals in the order in which they 
think the proposed projects shoulu be funded. 

There are distinct advantages to this form of 
proposal review: the participants are acknowledged 
experts who make absolute and relative judgments 
of proposal quality, or ''scientific merit," and who 
offer their time on a largely volunteer basis. The 
process is expected to operate according to values of 
fairness and expediency. However, at the two 
agencies that depend most on external peers, NSF 
and NIH, problems with and suspicions a* ^^ut 
systematic biases in proposal review have produced 



a series of studies and self-studies.^ Such studies 
raised questions about the con^sition of review 
panels and the fate of proposals submitted by 
investigators at research universities.^^ 

Probably the most predominant criticism of peer 
review, and the one that has troubled Congress the 
most, has been the allegation that it is controlled by 
an ''old boys network,'* which informally favors 
those like themselves, and that decisions are made 
behind closed doors where aspersions can be cast 
against a researcher without providing a forum for 
refuting them. Attempts have been made at both 
NSF and NIH to correct faults found in peer review, 
but neither agency would suggest that all of the 
problems have been fixed. Rather, given the strength 
of peer review in soliciting expert opinion, they ask 
"what method is betttrV'^^ 



Manager Discretion 

Manager discretion as a project selection method 
refers to agency investment in the expert judgment 
of a single decisionmaker or administrator — the 
program manager.^^ This is not only the technical 
judgment of the manager, but also his or her ability 
to put together the best portfolio of research to 
achieve the goals of the program. Manager success 
is therefore seldom evaluated on the basis of one 
project or before a series of projects are complete. 
Rather, it is based on the success of an entire 
research program. In agencies that rely heavily on 
manager discretion, there is strict accountability of 
managers for program decisions. But managers do 
not work in isolation; there is oversight from 
superiors, and inhouse advice is readily available. In 



^^^TbcK iit reviewtd in D£. Cbubin nod E.J. Hackett, Pttrltss Science: Peer Review and US. Science Policy (Albtny, NY: SUNY Preii* 1990), 
cbs. 2 tDd 3; U.S. Ocnenl Accounting Office, University Funding: Ittformaiion on the Role of Peer Review at NSF and NIH, OAO/RCBD47-87FS 
(Washlngtoo, DC: March 1987); and NIH Peer Revkw Committee. "Sustaining the Quality erf Peer Review: A Rc(>orl of the Ad Hoc Panel'* 
uopubUihed repoit, December 1 989. Early itodiea of note inchide: NIH OranU Peer Review Study lbani« Grants Peer Review: Report to the Direaor, 
MH Phase I (Waihingtoo, DC: December 1976); Once M. Caller, What We Know and Do Not Know About the Peer Review System, report 
N* 1 878-RC/NIH (Sama Monica, CA: RAND Corp., June 1982); Stephen Cole et al.. Peer Review in the National Science Foundation: Phase I of a Snidy 
(Washington, VC: National Academy of Sciences, 1978); and Jonathan R. Cole and Stephen Cole, Peer Review in the National Science Foundation: 
Phase II of a Study (Waihington, DC: National Academy of Sciences, 1981). 

^^For a recent ejuunple of luch anaiyiii at the National Science Foundation, see Jamei McCuUough, ' 'First Comprehensive Survey of NSF AppUcanU 
Focuses on Their Concerns About Proposal Review,*' Science. Technology, d Human \blues, vol. 14, No. 1, winter 1989, pp. 78-88, and associated 
conmientaries that follow the article. 

^^See Jon lUmey , ' 'End of the Prer Show, ' ' New Scienrist, vol. 1 2.7, Sept. 22, 1 990; and Jeremy Cherfss. * 'Peer Review: Software for Hard Choices.* ' 
Science, vol. 250, Oct. 19. 1990» pp. 367-368. 

^^What OTA is calling ' 'manager discretion** is discussed in the organizations literature a.^ a management tool or approach that springs^ for example 
in the case of the National Aeronautics and Space Administration space program, from ". . . the complex conceptual, planning, administrative, and 
evaluative tasks facing the agency and its contractors." See Karl 0. Hair. Jr. and Virginia C. Lopez, "The National Aeronautics and Space 
Administration: Its Social Genesis, Development and Impact, ' ' Managing Innovation : The Social Dimensions of Creativity, Innovation and Technology, 
S.B. Lundatedt and E.W. Colglazier (eds.) (New York, NY: Pergamon Press. 1982), p. 181. 
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particular, technical judgments of inhouse staff a^e 
commonly solicited, and additional reviewers can be 
tapped from outside the agency. 

Manager discretion has many advantages as a 
funding allocation mechanism. First, because pro- 
gram managers are intricately involved in the 
development of a program, they can best gauge the 
relevance of projects selected for funding to program 
objectives. Second, manager discretion allows an 
agency to implement new goals quickly, since it is 
easier to instruct managers to alter selection criteria 
or allocation methods (and hold them accountable 
for doing so) than to convince external peer review- 
ers to weigh factors others than technical merit in the 
rating of proposals. Finally, the ethos of manager 
discretion can result in the funding of proposals that 
do not reflect the collective wisdom in vogue. As put 
by one manager at the Office of Naval Research, 
where manager discretion is the rule: **We don't 
take votes in the science community."^ 

However, manager discretion can also suffer from 
isolation — soliciting too little opinion from outside 
of the agency, as well as relying foremost, and 
sometime solely, on the technical judgment of the 
program manager. Manager decisions can also be 
seen as capricious, since they are not based on a 
consensus aniong peers. Also, wherever manager 
di.scretion is used as a decisionmaking device, it 
assumes an organizational structure that recognizes 
managerial responsibility for activities and objec- 
tives witliin time and cost limits. 

Although on the surface peer review and manager 
discretion seem very different, many agencies use a 
combination of the two in theii' decisionmaking. 
What follows is a brief description of the funding 
allocation methods in the major research agencies. 
For a more detailed discussion, see appendix C. 

Agency Overview 

NIH can be considered the original site of peer 
review in the Federal Government, beginning with 
the National Aiivisory Cancer Council in 1937.^^ 
Tbday, NIH has an elaborate ''study section** 
system for soliciting and reviewing proposals from 



extramural researchers. Section secretaries** are 
pivotal in proposal processing. Study sectionrecom- 
mendations are directed to 1 of 13 institutes and 
must ultimately be approved as funded projects by 
the appropriate advisory council. NIH intramural 
researchers located in NIH laboratories around the 
country compete for separate support. NIH uses 
almost 100 chartered panels to recommend deci- 
sions about the relative merits of proposals.^ 

DOD research agencies rely primarily on inhouse 
review and manager discretion. DARPA in particu- 
lar is known for its strong program managers. 
DARPA solicits proposals tailored to a field of 
interest and specific research objectives. Funding is 
awarded (and withdrawn) ahnost exclusively at the 
discretion of the project manager. The Office of 
Naval Research controls most of the 6. 1 funding for 
the Navy and is also noted for the independence of 
its program managers who are often referred to as 
**czars." The Air Force Office of Scientific Re- 
search disburses all of the Air Force's 6.1 budget, 
both to its own laboratories and to universities, with 
inhouse review and manager discretion decisive in 
project selection. Army research programs are de- 
centralized, and inhou'je review is used to allocate 
monies to universities and numerous DOD laborato- 
ries. The University Research Initiative in the Office 
of the Secretary of Defense supports additional 
research at universities. The funding, however, is 
allocated through the services and DARPA. 

Research proposals at NASA are processed differ- 
ently by the Office of Space Science and Applica- 
tions and by the Office of Aeronautics, Exploration, 
and Technology. At OSS A, proposals relating to 
future flight missions are solicited through An- 
nouncements of Opportunity (AOs). Research An- 
noimcements are more modest in scope than AOs, 
and can solicit **gue.st" observers (who will partici- 
pate in a mission after the original investigators) and 
support theoretical work. Unsolicited proposals are 
also considered. Funding is based primarily on 
technical merit reviewed by an expert panel selected 
by the program manager, an inhouse group, or an 
outside contractor. NASA staff provide further 



^OTA inicrvicws al Ihc Office of Naval Research, spring 1990. 

^^llic Nalional Iristitules of Health epitomises how much project selection can be influenced, in the long run. by the very icientisls who receive the 
funds. Sec Niciiolas C. MuUuu. "TIk Structure of an Elite' The Advising Stnicture of the U.S. Public Health Service/' Science Studies, vol. 2, 1972, 

pp. 3-29 

^'^llic Natiorui) laslitules of Health ix llie Lirgu^l pan of the Department of Health aikl Humun Services; only one other component of this department, 
titc AlcolK>i» Drug Abuse, awl Mcnui Health Ailnuiustralion, supports exlrumurol research. 
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review to determine feasibility and mission rele- 
vance. Proposals are ranked and the program man- 
ager selects from the top 20 to 40 percent. Division 
managers must approve these selection s.^^ At 
OAET, proposals are solicited through Requests for 
Proposals. All responses aie reviewed inhouse, and 
most grants and contracts are administered by 
NASA laboratories, In ail, one-half of OAET's total 
R&D funds is disbursed to the laboratories (chiefly 
Ames, Langley, and Lewis), while 30 percent goes 
to indusuy, and 20 percent to universities. 

DOE'S civilian science programs use many of the 
same proposal review techniques as NASA, with 
peer review of scientific merit and final judgment by 
the program manager. All proposals are solicited 
through Broad Agency Announcements. The major- 
ity of research funds are awarded to the laboratories, 
and these expenditures are estimated in the budget 
request for DOE. Almost all of the agency's defense 
research is done at the laboratories; funding is 
competed among them and distributed on the basis 
of inhouse reviews. 

NSF funds only extramural research.^^ It uses 
program announcements and, through its system of 
''rotating" program managers, routinely circulates 
members of the research community into the 
agency's decisionmaking apparatus. Although peer 
review is the guiding principle of NSF proposal 
review, its form varies greatly within and across 
agency directorates, divisions, and programs. 

USDA is a multilimbed agency. The funding 
procedures of the Agricultural Research Service are 
highly centralized and totally inhouse. Proposals are 
received in response to an annually revised 5-year 
National Program. They are sent for external review 
only after the decision to fund has been made and 
only to approve the dollar amount of support. The 
Agriculture Grants Program of the Cooperative State 



Research Service is a separate arm of USDA. 
Outside panels rank proposals and, along with 
program managers, determine funding levels. CSRS 
also has ''nationally targeted programs" and ''spe- 
cial programs/* the latter being congressionally 
earmarked funds. Both categories are supervised 
inhouse. The Forest Service is another arm of 
USDA, witli stations scattered around the United 
States competing for funds from the National 
Program. Research work unit descriptions are solic- 
ited from all of the laboratories and are competed at 
the national level; outside review is rarely solicited. 

Blurring of Peer Review and Manager 
Discretion 

This overview illusU'ates the various combina- 
tions of peer advice and manager discretion used in 
the research agencies. Some research agencies have 
always used a particular method — DOD has consis- 
tently relied on manager discretion augmented by 
informal reviews. Some agencies have recently 
altered their methods. 

For instance, NSF renamed its proposal review 
process "merit review" in 1986 to reiterate that 
''merit" consists of more than peer judgments, 
especially relevance to agency missions.^^ Likewise, 
NIH stresses the role of institute advisory councils 
in weighing priority scores against program rele- 
vance^^ (for an example, see box 4-E). While it has 
always been the case tiiat technical merit is a 
necessary but not sufficient condition for research 
funding at agencies other than NSF and NIH, the 
exercise of manager discretion in the selection 
processes of these peer review-based agencies has 
become more explicit. 

The issue is not which method, peer review or 
manager discretion, is better, but that eitlier one, or 
a combination, can be used effectively to address 



*'Othcr rii5crctionary money {reprcwnling about 1 0 percent of the budget) is available to the di v ision dircctof and ibe program manager. It l.i d Ishurscd 
for projects of higi)cr risk, or for specific needs not addressed Uuough the procedures described above, using a less formal procedure (sooiclinies only 
wilb internal review). 

^For example, in fiscal year 1989, the National Science Foundation (NSF) received 44,300 proposals and made 1 6,700 awards. The agency supports 
U>e research of 1 8.900 i^cieiuisis (including salary for an average of 2 months each year), 3,600 postdoctoral researchern, and 1 5,600 graduate students. 
The average award amount to individual investigators ranges across directorates from $50,000 to $150,000. Comparable information in all of these 
categories, over the last decade, is lacking for the other agencies except the National Institutes of Health and the Department of Veterans Affairs. Sec 
U.S. Congress, Office oflbchnology Assessment, "Proposal Pressure in the 1980s: An Indicator of Stress on tlie Federal Research System," staff paper 
of the Science, Education, and Transportation f^rogram, April 1 990. pp. 4-7, and tabic 1 . Since publication of the OTA suff paper, NSF has developed 
revised numbers for competitively reviewed proposals: 27,300 received and 8,400 awarded with a median annual award of $55,000. Linda Parker. 
National Science FK)undation, personal communication! Jan 23. 1990. 

^National Science Found^<tion. Advisory Commiitce on Merit Review, rinai Report, NSF 8f^93 (Washington, DC: 1986). 

^For a historical perspective, sec Stephen P. Suicklimd, The Story of the NIH Grams Programs (Lanhani. MD: University Press of America. 1989). 
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Box 4-E— Fine-Tuning Project Selection at NIGMS 

Hie mission of the National Institute of General Medical Sciences (NIGMS), one of the 13 National 
Institutes of Health, is the support of basic research in the life sciences. Eariy in 1990, the Naticm&l Advis(»y 
General Medical Sciences (NAGMS) Council issued new guidelines that expand the factors taken into 
consideration by die scientific staff in maldng project funding decisions.' "In times of extremely 
constrained funding,'* the NAGMS Council stated that "... the Institute [must] promote the broadest 
possible diversity of ideas and a|^roaches, ..." and **. . . encourage the ideas and talents of established 
investigators and of die young or new investigators who will provide the next generation of research 
accomplishments.'* The NAGMS Council recommended a policy authorizing diat special considenution be 
given to a highly rated application fram an invesdgator". . . who has no other significant source of research 
support ..." as opposed to such applicaticms ftom investigators . . whose total research mppott from 
ail sources, including the pending award, exceeds $300,000 (direct costs).'* 

Under this policy, the advis(»y council chose to free up funds by: 1) reducing die amount of funding 
received by some investigators in die $500,000 plus catcgoiy, 2) not approving two awards for projects dut 
were within the "dieoretical" NIGMS payline, and 3) cutting 30 percent of die competing continuation 
grants (60 out of 200) beyond die 12 percent across-die-board reduction. As a result of diis shift of ftuids, 
6 percent of institute awards (n«21) were made to . . grantees who had no other significant source of 
research support and who also had percentiles that were beyond dw dieoretical Institute payline, . . . ** i.e.. 
who would not have been funded under die traditional NAGMS guidelines. 

What are die lessons derived from diis advisoiy council action? There ate at least two appraisals. The 
positive one is dut an NIH advisory council is searching for ways to support investigaton widiout 
compromising die integrity of eidwr the peer review system or die research to be Auded. Priority scoies 
were intended as die chief input to. but not die sole determinant of, award decisions. The NAGMS Council 
recognizes die imprecision of priority scores at die margin, and does not embrace dieir use as die sole 
criterion for funding. 

An appraisal dut is more negative is most clearly stated in a letter sent in June 1990 to Acting NIH 
Director William F. Raub.^ Citing . . Uttie comfort in die idea dut die change is only temporary, . . ." 
die audior notes diat " . . . dure will always be a case to be made for redistributiooist policies, because diere 
are always more losers than winners and many of die losers are quite meritorious." He protests dut pea- 
judgments about die quality of science will be secondary to consideration of die financial condition of die 
applicants. 

AnoUier criticism is dih.' die new NAGMS policy is merely another in a series of ad hoc responses to 
die problem caused by die insufficient number of new and coasting grants, ". . . ritther than looking 
broadly at NIH's total research and training pmtfolio and die adequacy of its bud^ to support it . . . NIH 
has oUier programs to achieve odier purposes: for example, du special program for young investigators. We 
support those programs and want diem to be adequately funded. But the core NIH research grant programs 
should not be used to solve problems extraneous to their {m^r goals."' 

Expanding die pool of supported investigators, especially die "next generation." and diversifying die 
approaches to research diat fall wiUiln die NIGMS mandate is part of die NIH mission. On die odier hand, 
die NAGMS policy is seen by some as tampoing widi die traditional NIH review system. This use of 
discretionary action by program officers and advisors should be applauded, but continues to be a source of 
debate in government and die scientific community. 



'Tlie following is paraphrased or quoted from NatioiuU Advisory Oeneral Medical Sciences Council. "Januaiy 1990 MoCion and 
Guidelines Regarding Funding Decisions." unpublished tnanuscript. Feb. 8. 1990. 

^Exccrpis from the letter are used below to illuttrale genaic points probably held by others. The anonymity of Uw author is preserved. 
•^Ibid. 
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programmatic goals (and the choice of which 
method depends on the goal).'^* In general, OTA has 
found that the agencies will often adapt funding 
allocation strategies to new goals. 

Set-Asides and Formula Funding 

In addition to the mainstream disbursal of funds, 
agencies often allocate funds using other types of 
programs. The two prominent categories of such 
programs are set-asides formula funding. While 
their origins differ, each method of funding clearly 
allows the Federal research agencies the discretion 
to pursue certain national needs by applying a 
different or reordered set of criteria to the selection 
of research performers. 

Set-aside programs are agencywide discretionary 
actions. They select one characteristic that captures 
a need not served by mainstream proposal review 
and restricts competition for research funding to a 
pool of eligibles '.ho qualify by virtue of that 
characteristic. Thus, there are set-asides for women, 
ethnic minorities, young investigators, investigators 
located at traditionally nonresearch institutions, and 
investigators residing in States that have been 
underrepresented in the amount of Federal research 
funds they receive relative to their share of the 
general population or the number of undergraduates 
they enroll. (There are set-asides in odier agencies as 
well. See box 4-F.) 

The assumption underlying set^aside programs is 
that there are capable researchers everywhere who — 
for lack of opportunity or obvious disparities in 
experience — are disadvantaged in the ordinary com- 
petitive proposal process. The solution is a separate 
competition, still organized around the criterion of 
technical merit, that pits like against like. (For a 
model of an NSF set-aside that attempts simulta- 
neously to strengthen institutional research capabil- 
ity and geographic diversity, see box 4-G.) For some 
researchers, set-asides are tlie only way into the 




Photo credit: U,S. D^pmtrrmt of Ermrgy 



Scientists study the results of a nudear m^snetlc 
resonance experlnient. Several agency set-asldo 
programs acklress the recrultnrient and retention of 
wonnen In scientific fields. 

Federal grants system; for others it is a springboard 
to continued competition in regular agency pro- 
grams. 

Formula funding can be traced to the Hatch Act 
(1887), which authorized the allocation of Federal 
funds to land-grant universities for the conduct of 
research.^^ These funds are a kind of categorical or 
block grant disbursed to the States, which enjoy 
considerable discretion in their use. lypically, the 
subject areas to be addressed by formula-supported 
research are selected by directors, deans» department 
heads, and faculty in the land-grant instimtions, 
within the broad guidelines of the enabling legisla- 
tive acts. Peer review methods may be employed at 
this decentralized level7^ In agriculture, competitive 
grant funding is used to augment formula funding 
that expands the science base, e.g., new research in 
agricultural biotechnology. 



^1 "It is nmch tiarder to rely on managerial dutcretiori in in agency that hiis responsibility for the health and progress of science. There is also probably 
value in a variety of blenus between managerial disaetiou and peer review in different agencies and in different programs of a single agency.* ' Brooks, 
op. cit., footnote 39. 

'^^Thc roots of formula funding are perhaps the strongest m agriculture, where Hatch and the SniiilwLever Act (1914) formulas (the latter directed to 
agriculturaJ extension services) prescribed allocations to each State proportional to the nugnitude of its agricultural enterprise. These proportions are 
indexed roughly to annual cashsaJes of agricultural products in the States arnl the Investment of State funds in the State Agricultural Experiment Stations. 
For details, see Don Holt. Illinois Agriculniral Experiment Sution, ' 'Recapturing (he Vision: The Case for Fonnula Funds/' proceedings of the 1989 
Annual Meetings of the AgriculmraJ Research Institute. Bethcsda, MD. May 1990. 

'^^For exionple. the criteria for project selation in agriculture include: potential economic and socijtl importance of the research activity to the Sute» 
•egioa and Nation; potential for the activity to generate other research support: need to fill gaps in agricultural knowledge; and need to provide continuity 
111 long-temi research programs Sec Don Holt, Illinois Agricultural Experiment Station, "Mechanisnu for Federal Funding of Agricultural Research 
and Development/* mimeo, August 1988» p. 4. 
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Box 4-F--Small Business Innovation Research Program (SBIR) 

The SmaU Business Develq>ment Act of 1986 (Public Law 99^3) requires Federal agencies that spend more 
than $100 million annually on extramural research or resMrch and development (R&D) to set aside 1.25 percent 
(when fiilly operational) of tftose ftmds for a Small Business Innovation Research (SBIR) prognun. ^ These programs 
are intended to encourage innovation by allocating grants or contracts specifically to small businesses conducting 
research on relevant topics. Mincnity firms are also encouraged to compete* 

The notion of a set-aside program for small businesseSi initiated by the National Science Foundation in 1977, 
was initially disparaged by the academic research community, \^o viewed the program as a drain on available 
funds. It was instimted govemmentwide in 1982, and now provides substantial funds for science and 
technology*intensive firms conducting research on agency objectives considered too risky to interest financial 
investors. The seed money supplied by the Federal Government for the initial phases of research is leveraged in later 
phases by private capital. The receipt of SBIR funds is considered an asset by some investors, who feel that it reflects 
a measure of endorsement by Federal granting agencies. 

The program has three phases. In phase I, projects are tested for scientific merit and feasibility. In phase 11, the 
principal research effort, successful fime-l projects are supported for up to 2 years. Products or slices that reach 
phase III are developed for private or government use. Before a project can enter frfiase III, it must secure additional 
sources of support because SBIR funding ceases after phase II. 

In fiscal year 1990, the U.S. Department of Agriculture funded 32 phase«I and 13 phase-II projects at a total 
of $14.1 million. The award rate was 10 percent. In the same year, the U.S. Environmental Protection Agency fiinded 
over 15 phase-I and nearly 20 phase-II projects at no more than $25,000 each. The Department of Commerce spent 
$1 million on 9 phase-I and 2 phase-II grants in fiscal year 1990. One of the largest contributors, by virtue of the 
size of its budget, is the National Instimtes of Health, which spent $73 million on SBIR in fiscal year 1990. 
Biotechnology companies have fared well under the NIH SBIR program and praise the program for giving them 
the boost needed to conduct high-risk research.^ 

SBIR was reauthorized in 1987 for an additional 5 years— until 1 993. It continues to be one of tlie few sources 
of direct Federal support for applied R&D conducted by small companies. 



^This act is based on a 1982 act (Public Uw 97-219) and a successful experimeotal program of the National Science Foundation (NSP). 
The sources for what appears below are prognun soUciutions of the Small Business Administration's and NSF*s Small Busings Innovation 
Research Programs, Washington FAX, Sept. 24, 1990, and National Science Fbundation staff, personal communications, December 1990. 

^But see Jeffrey Mcrvis. •'Scicarific Conflict of Interest Regulations Offer Loophole to Small Business Program," The Scientist, vol. 5, 
No. 6, Mar. 18. 1991, pp. 1,8-9. 
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ol jutts. ^iiaiUs. .ind conifiuis. Tliey are neeiled to 
otl».et unrci. o^ etahic Jiulirctt costs ol (MOjccls. m 
cliidini' ile[>ri\uMu)n on huildmus and eijuip 
nu'Ul. . . \U lic^. enlrah/ih): scientilic prioiily set 
tin|' ariil i^perar lorial !n.iiK!;»i'menr. the\ avinij capri 
* ious tnp (io\^n tl{.'rivh>ns .tnd overcome llie tieletert 
oUn a\er.»gnig cll.\! ol v tMK^nsiis haM-iI mana^^e 

''H«>!r ••(» . n |.i..{ri {» I 
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nienl. Critics of fonnula funds (ckus on the need for 
peer review, incorrectly implying that formula funds 
are ru)t allocated eornjx'tinvely. The peer review 
issue clouds other important issues, including . . . the 
inability of typical [ver ivview panels to apply site- 
i*nd siluation-s[K'cific cnierta/''^ 

Yet many .still tiuestion the review received tor 
lonuula funded projects, and lavoi funds awiirded 
through openly ciMn[H'(iti ve jnogriuns as '^belter 
s(ient.'* 

Hn{\\ set-a.sidcs ami torrnula furuling represent a 
torrnol legislated aiulAu' w ithin-ageney iccognilion 
that ceilain research goals lannot he achieved via 
conventional proposal review. Thus, agencv pro- 
givuns arc created lo liiiecl f'liinling that satisfies 
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Box 4-C— The NSF EPSCoR Program; Geography and Research Capability 

NnwJiere has the concern for regional distribution of f-'ederal research funds been belter institutionalized than | 
in the National Science F-oundatioii's (NSM Experimental Progrjun to Stimulate Competitive Research (EFSCoR).' 
Established in 1978. EPSCoR awards ", . . small amounts of money to 16 have-not States and Puerto Rico to use 
as a magnet to help their universities and local industries excel in one or more areas of scif.icc and engineering."^ 
The States arc Alabama. Arkansas, Idalio, Kentucky, Louisiana. Maine. Mississippi. Montana. Nevada. North 
Dakota. Oklahoma. South Caiolina. South Dakota. Vennont. West Virginia. Wyoming, and the Commonwealth of 
F*uerto Rico. 

■fhe EPSCoR States have fomiwl a nonprofit organization, the Coalition of EPSCoR States, that argues for I 
greiiter Federal investment in the development of science and engineering capability nationwide, Relative to the • 
Nation as a whole, the Coalition points out. EPSCoR States "... have low per-capita incomes, high unemployment. 
I>oor schools, retarde<l economic development, and low levels of science education attainment and scientific 
manpower production."^ Tlie EPSCoR States received 5.4 percent of Federal R&D funds in 1980. and 5.6 percent 
in 1987. By improving the competitive position of States with underdeveloped science and engineering fundamental | 
research infrastructures, EPSCoR hopes to contribute to the heallli of all reseai ch and development (R&D) within j 
the United States.* ! 

EPSCoR as Antidote I 

Selection as tin KPSCoR-eligible Stale allows the Slate to compeie for a research enhancement award of 
between $3 aiid $5 million over 3 to 5 years. Tlie money is awarded to a Iwid institution within a State to implement i 
the proposed Slate R&D plan, to stimulate academic rese<irch activity, and to enhance ihe competitive stature of j 
institutions in select rese;irch areas. ^ The size of a Stale's EPSCoR award is detennined by the quality, number, and 
type of projects; the current siatus of its research environment; the scope and magnitude of the proposed 
improvements; and the {x^tential lo demonstrate significiint change as judged by merit review.^ 

The objcciives of EPSCoR lue to increase the competitiveness of participant scientists and engineers—working 
as individual investigators, in research groups, or in a research center— to obtain other R&D funds; lo effect 
permanent improvements in ihe quiiliiy of science imd engineering research luui education programs; and lo ensure 
that improvements achieved through EPSCoR-initiated activities continue beyond tlie end of the EPSCoR grant 
period.^ 

EPSCoR caji also leverage investment from other sources; iuid, for every Federal dollar, three local dollars art 
bt!ing invested in support of EPSCoR from industry and otlier sectors.* In Montana, for example, about 220 
researchers have received aid and about one-half of iliem have gone on to win Federal grants through NSF's regular 
merit review system. Anoiher 20 percent have won support from non-Federal sources. South Carolina has enjoyed 
snnilar success: the mathematics departments ai both Clemson University and the University of South Carolina 
ranked 47th and 62d, respeclively. in outside support after participating in EPSCoR Previously, neither had been 
among the top lOO."^ 

^National Sc»encc roundiUion, Uivision of Research Iniliahon aiui Iinprovcnicnt, "Bxpcrimcnlal Progriini To SlimuJatc CompcUiivc 

Rcsc.vch, Program Plan 1W>-1995/' unpublished rqmrt, ri d. 

2jclfrcy Mcrvjs. "When Tlicrc's No! P.nough Money lu Clo Around," The SnefUist, vol 4. No. 8. Apr. 16. W(\ pp. I. K 

k^Mlilion of I .PSCoR Sialcs. "HPSCoR A Stale-Basal Approach lo Hxpamling Anicru an Rcscaich Capacily," a congressional briefing 

paper. fVh. 20. \'m 

•^Joseph (i Danek. "A M(h1cI Program for lUpanding ihc Nahon's Science and Kngineering Infrustruclurc." summary for the &nim\l 
meeting of ihc Arm-riLan Association for Ihe Advuncenient ol Science. New Orleans. l-A. Feb. 20. P>90 

^Joseph (I PaiR'k. Nalumal Science poundalion, personal LommunicaJion. Decemlx^r 19<X) By ils licscnptive language, the NHlion.il 
St icnce l-ouri<lalion apparently dtK-s not like to emphasi/e lJuu P.PSCoH is an "equity " program; railier it refers to F.PSCoU a.s a capacity huildmg ; 
piDgrain 

^'NaUonal Si.K-nct' l iuiml.ihim. up v it . fooinoU* I. p *^ . 
^Ibid . p I 

**l)anek. a\ . fnotrmte 4 

*^'olU'c'n ( (Udes. "Iniv Nsi- Prt>grini Mailed Model iot Broader I >islrihulK»n ol IIS lunds, * fhr Chri*niilf of Higher LJuititton. 
vol Ni> .IS. July 19^XK p Al ' 

Continued on next page 
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Box 4-C— The NSF EPSCoR Program: Geography and Research Capability— Oontinujed 
Prospects for Emulation 

Several statewide EPSCoR initiatives have created ongoing organizations dedicated to the long-term support 
of science and engineering research. Included are the following; Montanans on a New Track for Science; Louisiana 
Stimulus for Excellence in Research; Oklahcma Center for the Advancement of Science and Tbchnology; and 
Arkansas Science and Tfechnology Authority. Through participation in the EPSCoR program, tliese and other 
States have been able to target their weaknesses and make significant strides in meeting the needs and improving 
the quality of their research communities in select areas. 

EPSCoR was funded at roughly $1 1 million in fiscal year 1991. The EPSCoR Coalition is seeking additional 
funds from NSF and for the establishment of similar programs in other agencies. The National Aeronautics and 
Space Administration (NASA), for example, is embarking on a program to help academic researchers compete for 
NASA funds and to improve overall scientific literacy in underfunded States. The U.S. Department of Agriculture 
is considering the provision of seed grants to scientists who have not received competitive grants from them in 
5 or more years. 

The prospect of redistribution worries critics of EPSCoR who fear a dilution of research capability. They claim 
that EPSCoR undercuts peer review. But because the program aims to make States more competitive at a national 
level, it pits them against one another for limited funds. Acting Director of the National Institutes of Health, 
William Raub, also suggests that an EPSCoR-type program may not be transferable to the health care arena. Many 
poorly funded colleges simply do not possess an adequate research infrastructure; there is no clinical program or 
animal facility in which such research might be supported. 

Thus, if expanding the EPSCoR model across Federal agencies is to be seen as a serious intervention, then 
several questions remain. In the face of a tight Federal budget, how much money should be devoted to assisting 
scientists and engineers in some States to Income more competitive? (Would doubling or tripling the amount of 
the annual EPSCoR award muhiply or hasten returns?) At what level has a State made enough progress to graduate 
from EPSCoR, or fallen behind enough to be added to the list?^^ 

Quantitative measures of success must also be developed. Areas that might be examined include: the extent 
of increased competitiveness for Federal R&D funding among individual investigators and research groups, the 
scope and effectiveness of departmental and institutional enhancements of the research environment, and the 
demonstration of Icmg-term State financial support of EPSCoR to advance the cause of education and human 
resources for science and engineering.^^ If broader geographic distribution of Federal research funding is sought, 
the EPSCoR model could be emulated. 



lODaiwk. op. cil., footnote 4. 

^^Nftiional Science Foundation, op. cii., footnote 1, p. 2. 

^^Mervis. op. cit., footnote 2. p. 12. The Dcpartn)ent of Bnergy, the Department of r>efense, uhI the Environiaentai Protection Agency 
were all directed by the 1 01 st Congress to introduce EPSCoR programs. Sec Audrey T Leatb, * 'Congress Heaps Funds on EPSCoR for Research 
in •iiavc-Noi' States," Physics Today, February 1991, pp. 77-78. 

'^Cordes. op. cit.. footnote 9, p. A17. 

l-*lbid., p. 12. 

15lbld..p.A17. 

^^ivcn the concentration of ethnic minorities in many EPSCoR States, the human resources potential of the program to increase 
participation in scientific careers has yet to be emphasized, except in Puerto Rico. EsUblished in 1980 with EPSCoR and University of Puerto 
Rico support {and subsequently from the National Science Foundation's Research Centers of Excellence Piognm in 1988), the Resource Center 
for Science and Engineering offers progranu at every stage of the educational pipeline. The university has awarded 91 Pb.D.i in the sciences 
in the \M decade, making it the leading grantor of doctoral degrees to minority scientists. See Manuel Gomez. '*A Comprehensive Regional 
Center to Develop Human Resources in Science aiKl Mathematics in Puerto Rico/ ' presented at the Fifth EPSCoR Conference, Aug. 15» 1990. 



longsliuuling or emerging needs in ni)vel ways. Such 
departures are alinosi alway.s .seen as tiiliiling 
quality. i.e.» trading ofYexeelleiu e in rese;ireli for the 
tulfillineni of *\subsuiiary agency ot)jeciives. Bui 
at what point do these objeciives fvconie central to 

i. 



the agency mission, or adtlress multiple deficiencies 
in the distribution ot* research funds and the execu- 
tion of rcseaich? 

Tliis question cuts to the core of this study: What 
does the f'cdcral Government expect resciuch fund- 
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ing to accomplish? Entering the 1990s, OTA fore- 
sees agency funding criteria and methodsi on the one 
hand, and researcher expectations, on the other, 
changing to accommodate a wider range of demands 
imposed on the Federal research system. 

Summary 

In this chapter, OTA has uitroduced the Federal 
research agencies, and outlined their priority setting 
and funding allocation mechanisms. In general, the 
Federal agencies are characterized by diversity, 
pluralism, decentralization, and a division of labor, 
but together they form a comprehensive research 
system. 

Each agency follows its research mission, but 
there is much disagreement, both within the agencies 
and in various research communities, over what 
constitutes that mission. Agency programs and 
research foci change in response to shifting priori- 
ties, but as with all large organizations, this change 
occurs slowly. The pace of change is especially 
hampered in research by the long-term nature of the 
work and by the inability to reorient programs 
quickly. Risk-taking, flexibility, strategic planning, 
and redirecting agencies are longstanding chal- 
lenges. 



Agencies use a combination of peer review and 
manager discretion to allocate funds. In addition to 
the mainstream programs, agencies also create 
set-aside programs to foster the development of 
underprivileged parts of the research community. In 
another type of funding, some agencies (especially 
USDA) disburse funds by formula, which are 
allocated as block grants to specific institutions. 

Agencies have a good sense of their research 
constituencies and attempt to cultivate both their 
development and long-term responsiveness. Never- 
theless, much of the brunt of the pressure on the 
scientific community is reflected in agency pro- 
grams. Program managers must make tough deci- 
sions about where to allocate fiinds and how to 
support personnel, facilities, and equipment. 

In summary, agencies have the resources to adapt 
to changing internal and external priorities. How- 
ever, Congress may wish to increase agencies' 
ability to set and coordinate goals and to address 
other issues. These issues — ^priority setting at sev- 
eral levels of decisionmaking, costs of research, 
human resources for the research work force, and 
data collection and analysis on the Federal research 
system — are discussed in the following chapters. 
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CHAPTER 5 

Priority Setting in Science 



Even if we could double the science budget tomorrow, we would not escape the need 
to establish priorities, , , .At present we have no well-defined process . . , for systemati- 
cally evaluating the balance of the overall Federal investment in research and 
development and in the variety of fields that we try to serve. 

Doug Walgren* 



Introduction 

At every level of decisionmaking in the Federal 
research system, goals are outlined and translated 
into plans for their achievement. For the system to 
provide both continuity and flexibility in research 
funding, priorities are set, chiefly through the budget 
process. Both the executive Wid legislative branches 
have mechanisms to set priorities, many of which 
were detailed in the two previous chapters. How- 
ever, broad priority setting is generally resisted by 
the recipienli^ of Fe<leral funding because it ordor^ 
the importance of research investments, often in 
ways that groups within the scientific community do 
not suppo«-t, Tliis problem is especially perplexing, 
because there are few mechanisms and no tradition 
of ranking research topics across fields and subfields 
of inquiry. 

Priority setting can help to allocate Fc<ieriil re- 
sources both when they are plentiful, as they were in 
the 1960s, and when they are scarce, as is expected 
in the early 1990s. Governance requires that choices 
be made ultimately to increase the benefits and 
decrease the risks to the Nation. For example, 
decisionmakers in the Office of Miuiagement and 
Budget (0MB) routinely compare the projected 
costs, benefits, and risks of certain programs. The 
benefits of research increase technological capabil- 
ity, national security, health, economic activity, and 
educational resources. Setting i>riorities is a way the 
govermnent achieves national goals. 



In the grand scheme of things, research is one 
Federal concern among many, routinely costing less 
than 2 percent of the domestic and defense budgets, 
Research has traditionally been a favored part of the 
budget — only four budget areas have consistently 
received increases over the 1970s and 1980s: 
entitlements, defense, payments on the debt, and 
research,^ Consider the President's proposed fiscal 
year 1991 budget, The items in this $1.4 trillion 
budget are organized under five themes, The first 
theme, "Investing in the Future," features science 
and technology items most prominently among the 
10 categories listed (see table 5-1), Five of these 
categories explicitly mention science or research 
goals. 

What the Federal Government values more or less 
in research can be inferred in part from the Federal 
budget. The budget process compares the goals of 
the President, the Office of Science and Tfcchnology 
Policy (OSTP), the agencies, and Congress — not 
only what each seeks to achieve, but also how they 
plan to do so. However, no orgaiilzation looks across 
the Federal research system to determine the frame- 
work for making choices. 

From the discussion in chapter 3, one could con- 
clude that 0MB has been the surrogate for such an 
agent, with Congress then adding its own priorities 
through budget negotiations,^ The agencies spend 
these appropriated sums ba.sed on strategic plans that 
reflect their research missions, soiling long-range 
from short-range investments, weighing new initia- 
tives against ' 'out-year' ' corruniunents (in multiyear 



'Ooug Walgrcn. Chairman of ihc Subcomininee on Science, Rc.searc^l,a!^d Tfechnology* in U S. Congress. Hou«e Comniiitee on Science, Space, and 
Tkclmology. The Hearings on Adequacy, Direction, atul Priorities for the American Science and Technology Effort, lOlsl Coug.» Feb. 28.Mar, I. 1989 
(Washington, DC: U.S. Govcmnicnr Printing Offtcc» 1989). p. 1. 

^"Outlays by Category,'* Government Executive, vol 22. September 1990, p. 44. ruitljennore, within category of '*R^D." research haa seen 
much greater increases Uian development (which ^U5 dccrea.scd in constant dollars) since tlie late I9(>0s. Sec Ijois Ember, "Bush's Science Advisor 
Diacusscs I3cclining \^lue of RAD Dollan." Chemical <C En^incerinji News, vol. 68. No. 17. Apr. 23, 1990. pp. 16-17 

^For an overview, sec Elizabclh Baldwin and Ctiristophct T Hill, "llie Budget Process aiid l-arge-Scale Science Funding/' CKS Revtew. Fcbnjary 
1988, pp. 13-16. 
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Table 5-1— Summary of President Bush's $1.4 Trillion Fiscal Year 1991 Budget, 
items Listed Under Theme I: Investing In the Future 



Increasing saving, Investment, and productivity 

Expanding the human frontier 

Space: 

1. infrastructure 

2. Manned exploration (Space Station Freedom, Moon-Mars 
Mission) 

3. Increasing scientific understanding (global change, devel- 
oping comnf^rdai potential, other) 

Biotechnology 

Superconducting Super Collider 

Enhancing research and development 

1 . Doubling the National Science Foundation budget 

2. Qiobal change 

3. Agricultural research initiative 

4. HIV/AIDS 

5. R&O for advanced technology 

6. Magnetic ievitation transportation 

7. Science and engineering education 

8. Research and experimentation tax credit 

9. R&O by transnatior^ai companies 

Investing In human capital 

Education: 

1 . Preparing children to learn (including Head Start) 

2. Targeting resources for those most in need (including K'12. Educational Excellence Act. 
mathematics and science, historically Black colleges and universities) 

3. Education research and statistics 
Job training 

Enhancing parental choice in child care 
Ending the scourge of druga 

Protecting the environment (including global climate change research) 
improving the Nation's transportation infrastructure 
Bringing hope to distressed communities 

Preserving national security and advancing America's Interests abroad (including the 
Department of Defense research and technology) 

Preserving America's heritag e 

SOURCE: "PrssWent Bush's 1991 Budget Fact Shset." Jan. 29. 1990. 



awards), and allocating resources by program, pro- 
ject, and performer. Even this picture is too simple, 
however, since many decisions involve extensive 
debate within the government and the public, and 
developments within programs and the scientific 
community also influence the decisionmaking proc- 
ess. 

Congress wishes — jxjrhaps now more than ever — 
that the scientific community could offer priorities 
at a macro level for Federal funding. However, this 
community has long declined to engage in priority 
setting, claiming a lack of methods to compiire cUid 
evaluate different fields of science and desiring to 
maintain high levels of funding for all fields, instead 
of risking cuts in any particular one. It has fallen 



primarily to the Federal Government to set priorities, 
both among and within fields of science, and this 
situation will most likely continue through the 
1990s, 

In the scientific community » calls for priority 
setting are also often confused with calls to direct all 
research along specified lines. Even with greatly 
enhanced priority setting, one goal would certainly 
be the maintenance of funding for a diverse science 
research base. This priority has been preeminent 
since the Federal support of research bcgan.^ Other 
priorities would include training for scientists and 
engineers, and supplying state-of-the-art equipment. 
At present, the means to meet tliese goals are a 
matter of continuous debate and policy revision. 



<See U S Congress. House Comniillec on ScieiKC aiid Ifcclmology. Task Force on Science FoUcy. A History ofSaenct Policy in the United Slates. 
I940'I9H5, 99th Cong. (Waiihijigton. DC*. U.S. Govcnunern J*rmtiiig Office, September 1986) 
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In an era of greater priority setting, the Federal 
Govcmmenl would seek to target specific goals. For 
instance, the allocation of additional monies to the 
National Institutes of Health (NIH) for AIDS re- 
search, beginning in the late 1980s and continuing to 
the present day, has been a clear designation of a 
priority research area. Future decisions may center 
on ranking projects designated **big science/* since 
not all of them can be supported in the current fiscal 
climate. Similarly, fields that have received large 
increases in funding during the 1980s, such as the 
life sciences, may grow more slowly, as others are 
given precedence* 

Although priority setting occurs throughout the 
Federal Government, it falls short in three ways. 
First, criteria used in selecting areas of research and 
megaprojects (e.g., the Superconducting Super Col- 
lider (SSC) and the Space Station) are not made 
explicit, and appear to vary widely. This is particu- 
larly a problem at the highest levels of priority 
setting, e.g., in the President's budget and the 
congressional decision process. Second, there is 
currently no formal oi expUcit mechanism for 
evaluating the total research portfolio of the Federal 
Government in terms of progress toward national 
objectives. Third, the principal criteria for selection, 
"scientific merit" and "mission relevance," are in 
practice coarse filters. 

This chapter examines priority setting in the 
Federal research system. First, it describes the 
historical justification for priority setting and recent 
pressures stemming from budgetary constraints. 
Second, it reviews specific frameworks for setting 
priorities generated by various parts of the research 
system. (For a di.scussion of priority setting in other 
counu-ies, sec appendix D.) Most proposed frame- 
works include a distinction between "big" and 
"little" science, both as research sU'ategies and as 
accounts with certain expectations. But definitions 
are murky. OTA thus discusses the criteria applied 
to justify investments in various categories and the 
decisions that generate agency research "portfo- 
lios." Finally, the use of priority setting to clarify 




Photo credit: Nstionai A0ronmjtic$ md Spm>t AdmlnisMlofi 



Astronaut prepares exporlmer^s, which separate cells 
aoccfding to their electric charge, on board the Earth- 
ort>itlng Columbia Space Shuttle. The difference between 

big and llttie sdenoe Is murky, In psrt because the 
advent of new large equipment (such as the Shuttle) oft^n 
allows new forms of whet would be called "little science" 
when performed In other envlronnr^ents. 

goals, strategies, and outcomes is analyzed as part of 
democratic decisionmaking.^ 

Historical Justification for Priority Setting 

Investment in research is open-ended and uncer- 
tain in outcome. Thus, Federal decisionmakers bring 
different expectations and justifications to making 
choices in research. Recognizing this, Alvin Wein- 
berg* former Director of Oak Ridge National Lab- 
oratory, proposed over a quarter-century ago a set of 
* 'criteria of scientific choice."^ He w. )tc: 

Society does not a priori owe the scientist, even 
the good scientist, support any more than it owes 
support to the artist or to the writer or to the 
musician. Science must seek its support from society 
on grounds other than the science is carried out 
competently and that it is ready for exploita- 
tion. . . . llius, in seeking justification for the sup- 
port of science, we are led inevitably to consider 
external criteria for the validity of science, those 
criteria external to science or to a given field of 
science.^ 



^rhc Federal budget process plus the annual cycle of authorization and tppropriatjons hearings allow ample opportunity for iteration — to revisit 
projects, check their progress, revise cost and time estimates, and so on. Bui this is done piecemeal. SonK n^cchanism viewing the entire research portfolio 
is needed, perhaps on a different cycle than the budget. A more "ideal" Federal research portfolio could be constructed ilcratively~a process which 
could fortify the science base while allowing for the pursuit of .some, but not aU, new big science initiatives. 

^'wo papers on the topic, onginally published m Minerva, arc reprmtcd with additional discussion iri A.M. Weinberg, Rtfltctions on Big Science 
(Cambridge. MA: MJT l^cis. 19<i6) 

'^Ibid.. p. 72. 
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Weinberg's ''external" criteria consist of social 
merit and technological merit. They declare tfie 
support of science as a priority to be judged against 
nonscicnce investments and favor the **applied'' 
end of the research continuum. These criteria 
conjure up the potential applications and social 
value of scientific research. Science for society is 
epitomized by such investment criteria. 

Weinberg's ** internal" criteria, on the otlier hand, 
are those embraced by research performers and, to a 
lesser extent, agency sponsors. For them scientific 
merit is the prime justification for Federal support, 
one that **. . .puts value on the progress of the 
scientific enterprise as a whole. Knowledge produc- 
tion is thus held to be a meritorious activity in its 
own right. . . ."^ With no promised inunediate 
benefit to society, tlie support of research has a more 
esoteric justification, such as the "ripeness" of a 
field for exploitation that will advance the state of 
theory or technique. The significance of this out- 
come may remain within a research community or be 
shared only by specialists in neighboring fields. For 
them, such developments become a priority. Making 
this intelligible and persuasive to those who control 
resources, e.g., within agencies or to one's congres- 
sional representative, however, is what may influ- 
ence the policy process. A 1988 statement of the 
priorities issue suggests that the criteria have not 
changed much from Weinberg's original formula- 
tion (see box 5-A). 

Historically, the notion of CTiteria, with scientific 
merit at its core, rearticulates the social contract that 
tics Federal research funding policies to investiga- 
tors and research programs that bubble up to excite 
other specialists and agency sponsors. For Wein- 
berg, . . the purest basic science [can] be viewed 
as an overhead charge on the society's entire 
scientific and technical enterprise."^ This concep- 
tion of research as overhead on society's near-term 



goals has been reasserted of late with changes in the 
Federal funding climate. Under the strain of de- 
mands on the Federal budget, the call for priority 
setting has grown louder. 

The Funding Climate and Research Priorities 

The 101st Congress engaged in what has been 
characterized as "... six of the most consequential 
and rancorous science and technology debates. "^^ 
Four of these six are unambiguously research 
related; they are presented by Senate and House 
votes in table 5-2: mathematics and science educa- 
tion, the SSC, environmental protection, and space/ 
National Aeronautics and Space Administration 
(NASA). (Note the overlap between the items listed 
here and in the President's priorities.) The need for 
trained people, sophisticated instrumentation, the 
reduction of risk, and continued exploration of space 
reflect the relation of science and technology to the 
Nation's total market basket of investments, 

Even though R&D still sit in the vulnerable comer 
of the budget that carries the label of ''discretion- 
ary" spending, it's clear that science and technology 
no longer are viewed as flip-of-the-coin judgment 
calls. Rather, they are now seen as necessary and 
strategic obligations tied to national needs, and no 
matter hov/ awful the budget deficit looks, R&D will 
get better relative consideration than anything else in 
the discretionary sector 

However, under tight fiscal conditions, no part of the 
budget may fare well. As Association of American 
Universities President Robert Rosenzweig states: 

Another thing that concerns me ... is the dy- 
namic that seems to be set up by the next three to five 
years of budget problems. We're going to be fighting 
among ourselves a lot — universities and elements 
within universities. . . . The domestic discredonary 
[budget] pool ... is not supposed to grow for the 
next five years, save for inflationary increases. But 



•John Zimaii. An Introduction to Science Studies (New York, NY: Cambridge University Press. 19S4), p. 163. 

Weinberg, op. cil., foolnolc 6, pp. 97-99. Also sec Harvey Brooks, "Models for Science P\Mx\img,** Public Mmimstration Review, vol. 31, May/June 
1971. 

>^adcRouslu "Science and fbclinology in the lOlst Congress." Technology Review, vol. 93. No. 8. Novcmbw-Dcccraber 1990, p. 59. These six 
differed slightly in (he Hou.se and Senate, and two— having to do with the Clean Air Act and the B-2 Stealth Domtjcr — have arguably little science content. 

* 'William D Carey. "RAD in the Federal Budget: 19161990,*' Science and Technology and the Changinif World Order, colloquimn proceedings, 
Apr. 12-13. 1990. S.D. Suuer (cd.) (Washington, DC: American Association for the Advancement of Science, 1990), p. 48. 
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Box S-A— A Statement From the Scientific Community on the Evaluation of 

Competing Scientific Initiatives 

Tlie following criteria were proposed in 1988 for evaluating competing scientific initiatives. They are presented 
here (in abridged form) in tlie three categories developed by the authors.' 

Scientific Merit 

1. Scientific objective and significance 

Fxomple: What are the key scientific is^^ues addressed by the initiativi- ^ 

2. Breadth of interest 

Exarrples: Why is the initiative important or critical to llie discipline proposing it? What impact will tlie 
science involved have on other disciplines? 

3. Potential for new discoveries and understanding 

Examples: Will the initiative provide powerful new techniques for probing nature? What advances beyond 
previous measurements can be expected with respect to accuracy, sensitivity, comprehensiveness, and 
spectral or dynamic r^inge? In what ways will the initiative advance the understanding of widely occurring 
natural processes and stimulate modeling and theoretical description of these processes? 

4. Uniqueness 

Example: What are the special reasons for proposing this initiative? Could the desire<l knowledge be 
obtained in other ways? Is a special time schedule necessary for perfonning the initiative? 

Social Benefits 

1. Coniribution to scientific awareness or improvement of the human condition 

Examples: Are the goals of the initiative related to broader public objectives such as human welfare, 
economic growth, or national security? Will the results assist in planning for the future? Wliat is the 
{X)tential for stimulating technological developments that have application beyond this particular initiative? 
Will the initiative contribute to public understanding of the goals and accomplishments of science? 

2. Contribution to international understanding 

Example: Will the initiative contribute to international collaboration and understanding? 

3. Contribution to national pride and prestige 

Example: Will the initiative create public pride because of the magnitude of the challenge, the excitement 
of the endeavor, or the nature of the results? 

Pro};rammatic Concerns 

1. Feasibility luid readiness 

Examples: Is the initiative technologically feasible? Are there adequate plans and facilities to receive* 
process, analyze, store, distribute, and use data at the expected rate of acquisition? 

2. Scientific logistics and infrastmcture 

Examples: What are the lang-term requirements for special facilities or field operations? What current and 
long-term infrastructure is required to support tlie initiative and the processing and analysis of data? 

3. Community commitment and readiness 

Example: In what ways will the scientific community participate in the operation of the initiative and the 
analysis of the results? 

4. Institutional implications 

Examples: In what ways will the initiative stimulate research and education? What opportunities and 

challenges will the initiative present for universities, Federal laboratories, and industrial contractors? What 

will be the impact of the initiative on federally sponsored science? Can some current activities be curtailed 

if the initiative is successful? 
5 Iniernational involvement 

Example: Are there committnents for programmatic sup[>ort from other nations or international 

organizations? 
b. (?ost of the pr()[K)scd iniliative 

f\ xamples: What are the total costs, hy year, to the Federal budget? What {x)rtK>n i)f llie ioUi\ costs will l>e 

borne by other nations? 



'Adapted from JdIim A iJiillrui .nut I-ivvmim ('riiwc. "Scitin^ ^VjoriUcs Aiium^ Sticntific liiUiaiivos/* Afnerinin SnennM. vol 76. 
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Table 5*2— Favorable Senate and House Votes on Science Issues In the 101st Congress 

Senate votes 

Mathematics and science education programs: S. 695* President Bush's "Excellence In Er' -vatlon Act." includes $5 million (or a national 
Science Scholars program. Passed 92-8 on Feb. 7, 1990; R 37-8, D 55*0.* 

Superconducting Super Collider authoriiatk)n:H,R 501 9 appropriates $20.8 billion (or energy and water programs, Including $318 million 
(or the accelerator. Passed Liy voice vote on Aug. 2, 1990. 

Technology programs authorization: S. 1 1 91 authorizes $320 million In (Iscal year 1 990 funds for research on high-definition television and 
other new technologies through the Advanced Tlschnology Program o( the National Institute of Standards and Technology. Passed by 
voice vote on Oct. 26, 1989. 

House votes 

Superconducting Super Collider authorization: H.R. 4360 limits Federal spending on the advanced atom smasher to $5 billion, with $2.4 
bllllon more to come from Texas and foreign sources. Passed 309-109 on May 2, 1990; R 115-57, D 194-52. 

Mathematics andSdence Education amendments: H.R. 51 1 5 authorizes $1 .1 billion In fiscal years 1 991 to 1 995 (or congressional science 
scholarships and other education reforms. Passed 350-25 on July 20, 1990; R 123-25, D 227*0. 

Technology programs authorization: H.R. 4329 funds the National Institute of Standards and Technology through 1992, Including $100 
miillon In fiscal year 1 991 and $250 million In fiscal year 1 992 for research on high-definition television and other new technologies under 
the Advanced Technology Program. Passed 327-93 on July 11, 1990; R 83-90, D 244-3. 

National Aeronautics and Space Administration funding: H. R. 51 58 appropriates $1 4.3 bllllon for NASA. Passed 355-48 on June 28, 1 990; 
R 128-39,0 227-9. 

KEY: R«R«publlcans; D-D«mocr«U; NASA«National Aeronautics and Space AdmlnlJtratlon, 

^th tho Housa amj tha Sanata pa$sad tha Exoaiianca )n Mathamatica, Sdanca, and Enginaaring Act of 1990 (Public Law 101-589) In OctotMr 1900. and 
$149 million waa appropHatad. 

SOURCE: Baaad on Wada Roush. "Sdanca and Tadinology In tha 101 b1 Congrafis/' TiBchnology R^vi^w, vol. 93. No. 8, NovamtMr-Dacambar 1990, p. 65. 

listed in table 5-3. (Projects are compared under each 
category to compete for monies allocated within that 
category.) Note the convergence between the Sci- 
ence Advisor's (OSTP/OMB's) and the NAS Presi- 
dent's (and former Science Advisor's) formulations. 
Each emphasizes the separation of large projects 
requiring new infrastructure from **small science/' 
Press distinguishes human resources from national 
crises and extraordinary scientific breakthroughs in 
his primary category. Bromley places national 
political exigencies above all else,^^ whereas Press 
prefers to put these items into a ''political categoiy " 
of third priority. One effect of these rank orders is the 
seeming creation of separate accounts, i.e., that 
choices could be made within each category and 
then across categories. Of cour.se, such choices are 
being made by various participants in the research 



>2Quotcd in "A Good Budget for Science, But Troubles Lie Ahead/* Science A Government Report, vol. 20, No. 18, Nov. 15, 1990. pp. 1,4. In the 
President's proposed fiscal year 1992 budget, civilian RAD sfpcnding would rise 13 percent to $76 billion, with basic science Increasing 8 percent to 
$13 billion. Sec William Booth. '^President Put.s Fiscal Faith in Science.*' The Washington Post, Feb. 13 J 991, p. A17. Also sec Jeffrey Mervis, ^'Bush's 
Science Budget; Will It Hold?'' The Scientist, vol. 5, No. 5. Mar. 4. 1991. pp. 1, 6-7. 

>5Frank Press. '*Tbe Dilcnuua of the Golden Age." Congressional Record, May 26. 1988. pp. E1738-E1740. Press's categories and priorities are 
presented below. 

^^Bromley 's statement was augmented in September 1990 by a brief Office of Science and Tkchnology Policy document, '^IJ.S. Ifcchnology Policy." 
n»c document serves to bridge tlic roles of the private sector and the Fcdaal Government in research and development. Justifications for the President's 
fiscal 1991 budget requests for "education and training" aiul "Federal R&D responsibilities" are presented by agency in addition to discussion of 
federally funded technology transfer and Federal-Suie activities. See Executive Office of the Presidenlt Office of Science and Tbchnology Policy, "U.S. 
Ibchnology Policy." unpublished document, Sept. 26, 1990. 

**NoJc that scientific merit is assumed in both formulations and not explicitly stated as a funding criterion. The issue become:, one of first ranking 
scieiice projects according lo scientific merit and then assigning them to natioiuU goal categories, or alternatively suiting from a national goal and 
organizing a research stmlegy to meet it. 



everybody is going to be out to get more money. 
They all feel that they deserve and need more money » 
and they're probably right. 

These commentators, speaking 2 years after 
National Academy of Sciences (NAS) President 
Frank Press warned of constrained research budgets 
as "the dilemma of the golden age,**'^ suggest some 
accommodation to this reality: while the Federal 
Government could invest more in science and 
t^^chnology, the scientific community could do a 
better job of sorting research opportunities by 
whatever criteria chosen to assist decisionmakers at 
ail levels of the system. 

Science Advisor Bromley and Former Science 
Advisor Press have stated criteria and categories of 
priority tliat they consider essential for science. 
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Table 5-3— Two Statoments on Research Priorities 



Source 



Criteria 



Catejorles In rank order 



Bromley 



Press 



. . guiding principles on prioritiz- 
ing the agency requests . . 



. . appropriate for the unprece- 
dented Federal deficit . . and 
*\ . . to maintain American leader- 
ship In science and technology . . 



1. National needs and International security concerns (global change, 
preeminence In space, defense technology base). 

2. Support for basic research (particularly unlverslty-based, Individual- 
Investigator and small-group researctv-^small science"). 

3. Funding for scientific Infrastructure and facilities (SSC. Space Station, 
and . . In a more distilled sense . . Human Genonne). 

1. Human resources, national alses (AIDS, space launch capacity), extra* 
ordinary scientific breaMhroughs (high-temperature superconductivity). 

2. Large projects (SSC, Human Genome). 

3. Political category (DOD and national security; Space Station; regional 
economic developnrwnt and empioyment; U.S. Image enhancers like 
manned space flight; U.S. ''oomf^tltlveness" enhancers like education, 
training, and dvll sector RSD). 



KEY: SSC«Sup«rconducting Super Collider; DOD-U.S. D«partm«ntof DsftfiM. 

SOURCES: D. Ailan Bromity, "Keynole Address" Sd0nc9 Mnd Technology and th^ Changing World CW#r, colloquium proceedings, Apr. 12-13.1 990. S. L. 

Sauer (ed.) (Wasiilngton, DC: American Association for tha Advancement of Sdanoe. 1 990). p. 1 1 . Also see "Q&A With D. Aiian Bromley, Bush's 
Sclance Advisor," Sc/ence A Qov^mmeni Report, vol. 20. June 1 . 1 990. p. 5: and Prank Press. 'The Dilemma of the Qolden Aga," Congratsionat 
Racord. May 26, leSS, pp. El 73a-El740. 



system simultaneously. The congressional budget 
process may be the final arbiter, but even after 
Federal monies are obligated, choices at the agency 
and program levels occur. 

In addition to supporting meritorious research, 
most Federal research agencies would embrace the 
following as relevant to their mission: 

• to provide fiscal support to the research system 
(both the infrastructure needed to conduct 
research and the research itself); 

• to invest in human capital today (i.e., the 
research work force) and tomorrow (i.e., stu- 
dent apprentices); 

• to sustain the performance sector of research 
(especially the research universities) and to 
build institutional capacity (especially as 
viewed by region or State); and 

• as a factor in economic development and the 
application of research to solving local prob- 
lems. 

Clearly, not every program in every research agency 
can apply these as funding criteria without compro- 
mising any single one. 

In response to a congressional request in 1988, 
NAS also devised a framework for thinking about 
Federal science and technology budget priorities. 
The result is presented in table 5-4. In this four- 



category scheme, **agency budgets and missions** 
are viewed as separate from needs of the ^'science 
and technology (S&T) base," ••national [political] 
objectives," and •'major S&T initiatives." All are 
illustrated by NAS at the agency level, listing the 
following needs: educating science and engineering 
personnel; modernizing equipment and facilities; 
supporting a mix of basic and applied research; 
capitalizing on promising new research opportuni- 
ties; promoting interactions between related fields of 
science and engineering research; distributing re- 
search support by geographic region and type of 
institution; maintaining a mix of research modes, 
e.g., individual investigators, large groups, centers, 
and university-industry partnerships; and balancing 
competitiveness and cooperation with research pro- 
grams in other countries. 

If these items were interpreted as listed in order of 
importance^ top to bottom, the projects funded by 
the research agencies (indeed, the proposals re- 
ceived) might look quite different from the research 
projects currently supported. Priorities can perturb 
the funding system; they can redefine the ''haves** 
and ''have nots** (e.g., institutions, fields, investiga- 
tors) by changing the value of certain criteria. For 
instance, some agency funding decisions signal that 
a premium has been placed on other needs (see box 
5-B). 



»^TA inicfviewa at ihc Federal research agencies, spring-fummer 1990. 

*^NationaJ Academy of Sciences, Federal Science and Technology Budget Priorities: New Perspectives ami Procedures, a report in response to the 
Conference Report on the CoDciurcol Rcaolulioo on the Budget for Fiscal Year 1989 (li. Con. Res. 268) (Washington. I)C: National Academy Press* 
1988), p. to. 
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Tablf 5-4— Frarrawork for Asaassing Sclanco and Tachnology Budgeta (catagortaa tra not mutually exclusiva) 



Catagory 

Agancy budgets and 
missions 



S&T basa 



S&T applied to 
national ot)iectlve8 
(Presidential and 
congressional 
priorities) 



Major S&T Initiatives 



Pallnltlons 

Agency S&T activities viewed In terms of 
their contributions to individual agency 
goals and objectives 



Activities that provide the people 
knowledge, and Infrastructure to carry 
out S&T 

Activities supported across many 
agencies and under the Jurisdiction of 
several congressional committees 



Stated priorities of the President and 
Congress with ma)or S&T components 

Frequently supported by several 
agencies and within the purview of 
several congressional committees 



Significant Increase (and sornetlmes de- 
creases) In budgets over several years 

Budgetary consequences across 
agencies 

Fall In one or more of abc :} three 
categories 



Examples 

Nuclear alternative energy R&D In DOE 
Submarine acoustics In DOD 
Cell biology In HHS 
Influence on learning In ED 
Plant disaase resistance In USDA 
Fundamental research In chemistry In NSF 
Standards development In NIST 
Aeronautical resaarch bi NASA 

Basic and applied resaarch programs In NSF, HHS, DOD, DOE, 

NASA, USDA, EPA, etc. 
Student fellowshipe In ED, NSF, HHS, DOD, DOE, NASA. etc. 
Equipment and Instrumentation programs In HHS, DOE, NSF, USDA, 

NASA DOD, etc. 
Facilities for research, animal care, and growing and using special 

materials supported by NSF. DOD, HHS. DOE. NASA, etc. 
K-12 materials development In NSF, ED, NASA. etc. 
Student Internships In Federal laboratories In DOE, NIH, etc. 

Understanding and ameliorating global change In EPA, DOE, NSF. 
NASA, USDA, NOAA. etc. 

Industrial development In biotechnology, superconductivity, manu- 
facturing technologies In HHS, DOD, Commerce, NASA, NSF, 
DOE, USDA, etc. 

Alternative sources of energy In DOE, NSF, DOD, USDA, etc. 

AIDS In HHS. ED. DOD. State Department, etc. 

Creation of nuclear defense (Strategic Defense Initiative In DOD) 

Inaaase capacity for exploration of space (Space Station In NASA) 

Superconducting Super Collider 

Mapping and sequencing the human genome 

Space Station 



KEY: DOO-U.S. Departmsnt of Defsnss; DOE-U.S. Dspsrtmenl of Energy; ED-U.S. D«partm«nt of Education; ERA-U.S. Envirofim#ntsl Protection Agtncy; 

MMS-U.S. Departmtnt of Health and Human Servicaa: NASA-National Aaronautica and Space Administration: NIH-Nallona( Instltutas of Health; 

NIST-Natlonal Inatltuta of Standards and Tachnology; NOAA-Natlonal Oceanic and Atmosphario Administration; NSFfNationai Sdanca Foundation: 

R&D-rasearch and davalopmant; Sai-sdanoe and tachnology: USOA-U.S. Dapartmant of Agrkxjltura. 
SOURCE: National Acadamy of Sciences, fadara/ &ianoa mxi Technology Budget PrioritieB: Nm Penpectives and Procedures (Washington. DC: National 
Academy Press, 1988). table 1 . p. 7. 



Concern for the S&T base closely approximates 
the needs of research. In the words of the NAS 
report: 

The S&T base is the bedrock of the Nation's 
ability to use science and technology in the national 
interest and ... it requires continual replenishment. 
Continuity does not imply steady funding of the 
same activities and institutions through the same 
programs and agencies year after year. On the 
contrary, the enterprise ought to be highly dynamic. 
Policymakers must be able to respond flexibly to 
scientific breakthroughs that suddenly transform an 
area of research (e.g., high-temperature supercon- 
ductivity), the invention of a powerful new instru- 
ment (e.g., gene-sequencing machine) or concept 
tions of new facilities that would aid research and 
training (e.g., supercomputer centers and networks). 



unexpected sliortages of science and engineering 
personnel, or changing institutional relationships 
(e.g., the emergence of university-industry research 
partnerships). And as if that were not a sufficient 
challenge, budget makers and analysts must be 
attuned to differences among a wide range of fields. 
Some changes affect many disciplines, others only a 
part of a single discipline. 

Frameworks such as OSTP's and NAS's help to 
demarcate the tradeoffs that could be made and assist 
decisionmakers to understand that priority setting is 
a dynamic process. Priorities change with goals. As 
Weinberg put it: 

... we cannot evaluate a universe of scientific 
discourse by criteria that arise solely from witliin that 
universe. Rather, we find that to make a value 
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Box 5.B— Criteria for Awarding a Magnet Research Laboratory: NSF, Florida State, and MIT 

In August 1990, the National Science Board (NSB) of the National Science Foundation (NSF), decided to 
award a $60-nnllion gnint to Florida State University to establish a national laboratory for magnet research. 
Hien-NSF Director Erich Bloch admitted that peer reviewers had found the proposal from the Massachusetts 
Institute of Technology (MTI), home of the Francis Bitter National Magnet Laboratory, ''technically 
superlative/' but citwl the greater ''enthusiasm'' of the Florida investigators, the State of Florida's pledge to 
contribute $58 million, and other factors in fiuiding the Florida proposal.' 

'Tlie issues involved in the NSF decision are many. At one level, the award is evidence that scientific merit 
is not enough to giwrantce success in competition for a facility where there can be only one winner.^ NSF cited 
as decisive the superior **managemcnt phui" in the Florida proposal. Clearly, the message being sent— pan of 
Bloch 's larger emphasis on centers Juid government-industry partnerships to enhance U.S. economic 
competitiveness— was the rules of the game are changing: criteria other than technical merit are weighed in 
deiermining qualification to mmuige and execute a multiycar research program requiring the expertise of 
investigators from various institutions.^ ^ ^ 

In !hc magnet ialKmUory competition, the commitment of MIT was found wanting. According to NSF 
Assistant Director David A. Sanchez: . . you need support from the institution, you need support from tlie | 
State, and we did not see that ..." from MIT.'^ NSB concurred. | 

The MIT protest of Florida State's selection was not limited to NSF's decision to overrule its reviewers' 
recommendations. MTl' President Paul Gray api)eiiledon several grounds. First, tlie delay cause<l by construction 
of the Florida State facility *V . . is hardly compatible with NSF's interest in the competitive posture of the United i 
' Slates/' Second, some fear tliat projects with significant State support, so-called leveraging of Federal funding, 
will put private universities at a disadvantage. Hiird, exi)crtise in Uie Florida State physics department may be 
lacking."^ 

Consider, too. the symbi>lism of the decision. As one columnist put it: ''So maybe the mandarins from MIT 
got caught napping. Maybe. Or maybe not."^ MIT epitomizes the Nonheast science establishment.^ llie 
Soiitlica.st is. in a sense, an undemtilized region for research. Awards such as the magnet laboratory signify that, 
in specific cases, institutional collaborations urn make a State or region competitive for Federal research funding. 

Such awards build research capability almost from the ground up; they are a capital investment that j 
diversifies rese^irch pertbnners— with short- and long-term consequences for the re.search community and the 
Natit)n. Decisions such as this one also call for evaluation: what happens to magnet research while the Florida 
State facility is being constructed? Will the Slate of Florida deliver on its pledges? And is there jmy impact on 
the competitiveness of U.S. researchers in fields lliat use |>owerful magnets, such as superconductivity and j 
magnetic-resonance imaging? i 



•SceOoIdic Blumcnsiyk. ' •Science Agency Pick.s Ronda Slalc Over MIT as Silc fur $f)0'Million Mugncl-Sludy Ub." The Chnmu le j 
o) Higher i.iiuciinon, vol. No. I. Scpl. 5, 1990. p. A21. i 

^Tlic awurd of a 5-year. $25 million earthquake projcci lo a consorimni ccnicrcd ai ihc Sialc University of New York a! Buffalo sent 
a similar sigfuil lo Callech and a California con.sorimni in 1 987 Ii also led lo a Geiicial Accounting Office (GAO) invcsligalion of ihc Nalioiial 
Science F-oundaiiofi (NSfO review process th;it saiicMoried ihe award. While it sustained ihc fairness of the NSF process, \\ did question ii.s 
docunicnialion prtKcdures See U S General Accouniing Office. National Science foundation Problems Found in Dectswn Process for 
Awarding Earthquake Center. (iAO/RC'ED-87'146 (Washington, DC: June 1987). 

^Pionda Slate is lo be joined by tlie Uluvcriiiy of Florida and Ijus Alamos National Uiboralory in New Mexico in making ihc nuigiict 
lahoral(U7 a reality. j 

'^In Dhnijcnsiyk. op. cil . foolnoii* I. p A22 National Science Foundation reviewers said the Massachusetts htstitulc of Ifcchiiology 's j 
*Mecaying plant" would require subsuintial modcnii/atioii. Hie lasiitulion wdl submit a proposal for further support until liie Florida Stale | 
lalH)iatory begins operations in 1993. 

^All of these plus criticism of the National Science Board <c!^pccially the lack of ''working scientists" among its mctnbcrs) arc cited 
by a trio of Princeton physicists in Philip W. Anderson el al . **NSP Magnet Lab." letter. The Scientist, vol. 4. No 23. Nov 26. 1990. p. 
14 Tlie Plonda State proposal included h pledge from tlic Stale . to add 24 new faculty nwrabcrs and 10 laboratory experts and lo provide 
20 annual fellowships for vismng .scicnhsl.s from around the world " 

^David Wiirsh. "Will Florida Become a New Bastion of Industrial Science?" The Washiniiton Post, Sept. 12. 1990. p. C3 

"^'Hie Massachuselt^s hisiituic of l^lwiology coasoriium was to include Boston. Braiidcis, Harvanl. Northc«istcrn. and lUfts 
universitieN 
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Researcher studies magnetic liquids. In this example of 
little sdence. the research Is supported by the National 
Aeronautics and Space Administration. 

judgment, wc must view the enterprise from a 
broader point of view than is afforded by the 

universe itself And so it is with the rest of 

science. The scientific merit of a field must be judged 
in large part by the contribution it makes, by the 
iUumination it affords, and by the cohesion it 
produces in the neighboring fields. 

Leaders of the scientific community have subscribed 
to the need for something other than ad hoc 
policymaking for research funding. OTA next exam- 
ines the problems inherent in two categories of this 
funding — the science base and science megapro- 
jects, 

The Science Base 

Little science is the backbone of the scientific 
enterprise, and a diversity of research programs 



abounds. For those who believe that scientific 
discoveries are unpredictable, supporting many 
creative researchers who contribute to S&T, or the 
science base, is prudent science policy. In the words 
of one geographer: **The continued survival of our 
intellectual free market is important to scientific 
progress/'^ Not surprisingly, many investigators 
and their teams shudder at the thought of organizing 
Federal research funding around a principle other 
than scientific merit. They fear that setting priorities 
would change the criteria by which research funds 
are awarded.^^ They would run the risk of losing 
what they consider their fair market share. Does 
priority setting necessarily curb the search for new 
knowledge, or just redirect it? 

Consider the research portfolios of the Federal 
Government. As shown in figure 5-1, broad field 
funding, 1969 to 1990, has favored the life sciences, 
almost doubling in constant dollars during that 
period, Mathematics/computer, physical, and envi- 
ronmental sciences have also increased; engineering 
has remained stable in funding; and social sciences 
have decreased. In retrospect, should these be 
decried as less tlian rational choices? With a change 
in the Federal funding environment, sliould the 
ground rules for allocating resources among broad 
fields and perfonners also change? And what role 
can peer review play? 



Peer Review and Priority Setting Across 
Broad Fields 

Peer review is used in a variety of ways within the 
Federal agencies. As seen in chapter 4, only a few 
agencies, primarily the National Science Foundation 
(NSF) and NIH, employ peer review throughout 
their priority-setting and funding allocation pro- 
cesses. At NSF and NIH, peer review is considered 
to be: 

• effective for communicating expert opinion 
about what proposals definitely should and 
should not be funded (and the large gray area in 
between) within a narrow band of specializa- 
tion corresponding to the scope of an agency 
program; 



'Weinberg, op. ciL, footnote 6, p. 1 16. 

200. Robert Brakcnridge. •'Evaluating Scientific Initiatives. letter. American Scientist, vol. 77. No. 3. May-June 1990. p. 213. 

^Jll^L^f"^ "^"^ 1° "^'^ ^'^^^^ coiTcspond to strategies, v^h^e proj<ict selection tneihods (e « 

peer review) represent tactics or ways to idcnlify research that helps achieve stated prioriUcs. * * 
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Figure 5*1— Federally Funded Research by Broad 
Field: Fiscal Years 1969-90 
(In billions of constant 1982 dollars) 

Billions of 1962 dollars 
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NOTE: Research includes both basic and applied. Fields not included In 
this figure oolleciiveiy accounted for $1 .1 billion (4.9 percent) of all 
fi^derally funded research In 1990. Figures were converted to 
constant 1982 dollars using the QNP Implicit Price Deflator. 1990 
figures are estimates. 

SOURCES: National Science Foundation, F0d»ml Funds for Research and 
DBV0lopm0nt, DemiM Historical Tablas: Rscal Ve«« 1955- 
f 990(Wa$hinQton, DC: 1 990). table 25: and National Science 
Foundation, Se/ecfed Data on Fadaral Funds for R0$0arch 
and Devlopmant: Fisca) Yaars 1939, 1990 and 1901 (Wash- 
ington. DC: December 1990), table 1. 

♦ efficient, iii terms of the time, money, and 
energy involved in the process of deciding how 
resources should be allocated; and 

• accountable, ensuring that the highest stand- 
ards of rigor (valid and reliable measurement), 
safety (for aiiimals. human subjects, and labo- 
ratory personnel), iuid freedom (e.g., to follow 
hunches, train students, and exchange data) in 
research are observed. 

In sum, peer review is expected to be robust and 
responsive lo changing agency and program needs. 



Satisfying all of these criteria simultaneously, how- 
ever, is difficult at best (sec box 5-C) and, in 
practice, a compromise is struck between them. 

Federal monies awarded to researchers for some 
expressed purpose other than or in addition to 
**scientific merit" are seen by many as inferior to 
monies for projects selected by peer review pro- 
cesses using scientific merit alone. Some are in- 
clined to the view that there is something inherently 
wrong with such ' Apolitical allocations. The policy 
issue is whether peer review can simultaneously 
serve to discern scientific merit and help in project- 
based priority setting. 

Reviewing for * •truth." as science policy states- 
man Harvey Brooks writes, differs from reviewing 
for "utility." Peer scientists are not very helpful 
with the latter. In Weinberg's terms, criteria of 
scientific merit clash with criteria of social or 
technological merit. Peer review as a tactic tends to 
break down when confronted with incommensurate 
information from competing disciplines, fields, or 
projects. As two commentators ask: 

Should peer review operate only to evaluate merit 
or should it also help establish priorities? Can it or 
should it be effective in changing the direction of a 
program, in allocating resources among programs 
within agencies themselves? These questions are 
significant because they challenge the assumption 
that peer review is the best possible way to allocate 
resources in the best overall interests of both science 
and society.^ 

Recognizing the limits of specialization, agencies 
maximize expertise in subject-focused programs. 
Specialists are quite well-suited to the task of 
making quality distinctions within disciplinary or 
problem-centered boundaries. But discriminations 
that must cross boundaries, no longer comparing like 
with like, are rarely ever accomplished by peer 
review, since reviewers in one field are very 
reluctant to judge the scientific or technical merits of 
information from other fields. There are no lules 
inside the scientific enterprise that suggest that one 
kind of information is superior to another. Tlie 



IK). 



^Hiirvcy Brook.s, "T\\c Problem of Research Prionlics." Daedalua, vol. 107, No. 2, spring 1978. pp. I7I-I90. 

^^Riclufd C. Alkimon iUiU Willjaiii \. DIanpicd. '*Pe<rr Review and the Public Interest,' ' lisues in Scietu t Tei hnoio^y, vol. 2. sununcr 1985, p. 
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Box 5-C— Peer Review In Changing Environments: Remarks at a Roundtable Discussion 

In June 1990, the Forum on Research Management (FORM), consisting in equal parts of program 
officers from tlie behavioral science divisions of various Federal agencies and of senior researchers and 
research managers from academia and the private sector, met to discuss peer review.* Two dozen FORM 
members discussed some of the pros and cons of peer review in an era of fiscal austerity, Their positions 
as agency administrators faced with allocation decisions, as lobbyists surveying the funding scene, and as 
resCiU'chcrs competing for scarce program dollars give them an acute sensitivity to proposal review and the 
environments in which it is carried out. The remarks are as verbatim as tlie edited transcription allowed. 
Hach bulleted item represents a different speaker, 

• There is a connection . . . between tight funding and peer review. As money gets tighter, peer 
reviewers become more conservative, less prone to take risks. 

• What tliey (peer reviewers] arc doing is giving higher and higher ratings, which in effect increases 
the noise in tlie system. So the peer review system is calling more proposals "excellent" and 
* 'outstanding," and tlie consequence is that it is very difficult for program managers to make 
evaluations. What results is a beauty contest or just chance, 

• Has tJic .science changed? Has the quality of the proposals changed? I think the answer to both 
questions is yes. . . . Peer reviewers used to be tightly knit groups examining proposals from people 
they knew extremely well — it was a very closed society. Now it is a much more complicated task. 

• Would it really be valuable to have a peer review system and an amount of money where everything 
was funded? I suspect it may lead to very bad science, 

• There are two things going on in peer review—one is .selection, which is important, but the other 
is education (of the proposer and reviewer). I think tlie latter function sometimes gets lost, 
Unfortunately, crushing workloads are reducing the educational function of peer review, 

• When 1 serve on a (National Institutes of Health] study section, I finti it extremely disconcerting and 
distracting to l)e told by program people about what percentage ot ilie applications are likely to be 
funded. It distorts my entire approach, as well as tliat of my colleagues. For instance, if we're told 
only 10 {)erccnt are likely to be funded, we stxirt playing with the ratings to ensure certain results, 

• Study .sections are not supposed to be making funding decisions. They are to make scientific 
recommendations. There should be recognition that there are two discrete sets of staff used in NIH 
peer review. . . . Priority scores do not determine funding. That's what advisory councils md 
institute directors are for. 

• People aie increasingly reluctiint to get involved |in peer review]. ... 1 wonder if we are losing 
certain types of reviewers from the proces.s — not just to get women and minorities on the 
panels— witli increa^sing demands on time. 

The.sc t)bscrvalions illustrate the challenges posed by competition and resource .scarcity. Other 
challenges include iJie con.sequences of age and prestige on the allocation of Federal funds, the fate of 
proposals that cross disciplines and fall between agency programs, and the psychology of collective 
decisionmaking.^ Debate on the burdens absorbed by Federal f>eer review systems is healtliy if it informs 
the practices of agencies, investigators, and reviewers. 

'Itu' f'omni (111 Research Mana^crncnl w:is ca'.iU'tl in 19K2 its a worliuig group of the nonprofit Fedcnilion of Behavioml. 
Psychi)U)gKal. and (*<ignilivc Sciences Most of the alleiiclces at t)ic tncetin^ were frnin ifie Njilioiu) SciiMicc foundation, the National 
Insntutes of Hcaltli. and a lew professioruil iissociations !icadt|nartered in W;iShjngtoii. DC. The excerpts below an: l>ascd on a imniicnpt of 
iJie meeting supplied hy David Johnson, executive director of the Federation. 

^Sonie of these tuive Inreii addressed empirically Sec the special issue. "Peer Review and l*ubhc Policy." Siieruf, Technology, 
Human V(j/wr\5. vol 10. .N(j V sununer pp 
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This type of f tea beetle Is one of several studied by the 
OepartTDont of Agriculture to combat weeds. Researcti on 
animals and weeds Is very different from research on 
space explofatlon, and expert judgments require 
specialized knowledga. 

existence of such rules would imply that information 
from different fields could be made commensura- 
ble.2^ 

Peer review thus cannot help to set priorities 
beyond the limits imposed by agency organization. 
Wherea^s priorities and resource allocations for 
megaprojects are usually set by a tacit bargaining 
and lobbying process, the science base is governed 
by another dynamic altogether. As agencies evaluate 
their research needs and modify the emphases of 
their programs, research performers arc intimately 
involved. But seldom does a research community 



coalesce around a single agenda (for an exceptioni 
see box 5-D). 

The Dilemma of Agency Priority Setting 

Universities or States can be analyzed aa aggre- 
gate categories that receive Federal research monies, 
and agencies as the source of those sponsored funds. 
But the actual funding decisions are made in 
different agency programs and the research perfor- 
mance occurs in laboratories and departments.^ 
Decisions are thus made at several levels. Priorities 
that originate outside the agencies as ''national 
goals'' do not simply trickle down; they are adapted 
to what may be called an agency research portfolio, 
which in turn is comprised of various program 
portfolios (^'funding strategies''). Within these or- 
ganizational nicheSi i»iorities are set all the time. 
Thus, agencies may have the discretion to pursue 
certain national needs by applying a different or 
reordered set of criteria to the selection of research 
performers. 

Because disciplines tend to overlap agencies, 
priorities in physics, for example, can be set within 
an agency, but not readily across agencies. There is 
simply no routine mechanism for doing so. Physics 
research is distributed across three mission agencies 
plus NSF. While high-energy physics is supported 
primarily by the Department of Energy (DOE) and 
astrophysics by NASA, theoretical physics •'be- 
longs" to no single agency.^ This is even more 
dramatically apparent in the case of neuroscience. 
Congress and the President declared the 1990s the 
"Decade of the Brain."^^ As seen in figure 5-2, the 
Federal Government supports neuroscience research 
in 6 institutes of NIH; in 3 within the Alcohol, Drug 
Abuse, and Mental Health Administration; and in 10 
other agencies, with the National Institute of Neuro- 
logical Disorders and Stroke and the National 
Institute of Mental Health leading the way. Unless a 
"lead" agency is recognized by all participants (as 
in computer science, see box 5-E) or an OSTP 
Federal Coordinating Council for Science, Engi- 



WThal U, AlUioush lomc tgcijcici ujc peer panelj dut me multiple piopojtls tod make direct ccmpwiionj of propoied work in thdr field, they do 
noi compare ihclr finding* wiib those of panels in other fields, since between-field inforaation is held to be iocoouneoaurable. Instead. Ihcy Judge the 
technical merit of a research design, the competence of the Invcstigaion. and the institutional infrastructure available for executing the proposed design. 
As Harvey Brooks poinu out. who is the best Judge of social merit? There are no experts on social merit, which has to be a collective decision involving 
severmi different kinds of expertise as well as generalists' political Judgmenu. Personal communication, Febniaiy 1991. 

^PoT example, see NatioaaJ Science Foundation, ••Planning aed Priority-Setting in the National Science Foundation,' ' a report to the Committee on 
Science. Space, and Tbchnology of the U.S. House of Representatives. Feb. 28. 1990. 

^See. for example. Sebastian Doniach, '^Condcjised Matter Theory's Fragile Funding.* * letter. Physics Today. November 1990. pp. 13. 1 17. 

^^Elizabcih Pcnnisi and Diana Morgan, 'Brain Decade' Neuiosctenlisu Court Support," The ScitnHsu vol. 4, No. 21, Oct. 29. 1990. pp. 1. 8. 
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Box 5-D — Priority Setting by the Ecological Research Community 

In fall 1 990, (he Ficological Society of America proposed the Sustainable Biosphere Initiative (SBI), a research 
initiative thai focuses on tlie necessary role of ecologicJil science in tlie wise management of Garth*s resources and 
the maintenance of Earth's life support systems.* The process of developing the research agenda affirms that a 
community can set priorities.^ The document was intended as a calJ-to~arms for all ecologists. It was also to serve 
as a means of communication with individuals in other disciplines with whom ecologists must join forces. Many 
of t)ie environinenfal problems that challenge human society are fundamentally ecological in nature. 

In response to national and international needs, the SBI represents a framework for the acquisition, 
dissemination, and utilization of ecological knowledge in support of efforts to ensure the sustainability of the 
biosphere. The SBI calls for: 1) basic research for the acquisition of ecological knowledge* 2) communication of 
thai knowledge lo citizens, and 3) incorporation of that knowledge into policy and management dccisiofis. 

Research Priorities 

The chlena used lo evaluate research priorities were: 1) the potential to contribute to fundamental ecological 
knowledge, ajid 2) ihe potential to respond lo major hunum concerns about the sustainability of llic biosphere. Based 
on these criteria, the SBI proi)oses three research priorities: 

1. j^loha! i'hanjL^(\ including ihc ecological causes and consequences of changes in climaie; in atmospheric, 
soil, and water clieinisiry (including polluiiuiis); and in land- and waier-use patterns; 

2. hiolo^ical diversity, including natural and anthropogenic changes in pattenis of genetic, species, and habitat 
diversity; en)l()gical determin;uits and consequences of diversity; the conservation of rare and declining 
species; and the effects of global wid regional change on biological diversity; juid 

3. sustainahlr ecological systems, includijig the definition and detection of stress in natural and managed 
ecological systems; the restoration of diunaged systems; the management of sustainable e-cological systems; 
llie role of pesis and pathogens; die transmission of disease among humans; and ihe interface between 
ecological processes and human social systems. 

1-xisiinp national and international initiatives address parts of the first two priorities. Success of these programs 
will require increased emphasis on key ecological topics. The SBI pro|X)ses three research recommendations: 

1 . (ireater allention should be devoted to examining the ways that ecologicU complexity controls global prcKCSses. 

2. New a\search efforts should address both the im|K^rtance of biological diversity in controlling ecological 
pr(Kesses and the role that ecological ()rtK'esses play in shaping patterns of diversity at different scales of 
lime and space. 

3. A major new miegraled pn>gram of research on llie susiainabilily of ecological systems should t>e 
established. This prognun would focus on understanding the underlying ecological prcxresses in natural ruid 
humiui dominated ecosystems in order to prescriln: restoration and management strategies ttiat would 
enhance the susiainabilily of the liiutli's ecological systems. 

liiiplcMiientiition 

Siiccessful iniplcinenlalioii of the SHI will re(]uire new interdisciplinary relationships iJiat link ecologi.sis with 
the broad scieniitlc conimunity. with mass media and educational organizations, aiid with policymakers ;uid 
resource managers in all sectors of siK-iely. 

Ill sum. while the goals and actmn ilonis nf the .Susiainahic Bitisphere Initiative may not scetti revolutionary, 
trw CLuloiiists would have accepted them even a decade ago. But times have changed and so ha.s the science The 
|ui[>Ik is more awaic of cnvirniHuciiJal issues th;uj ever bcftuc, and opportunities for ccologist.shavc never Ixicn greater. ^ 

.Such statements are rare.* When they do appear, they can supply to policymakers iui unusual t(K)l forjudging 
a hierarchy of research crnphii.ses and {K^haps chiumeling resources to agencies and programs accordingly. 
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'The f.)ll»jwing IS hasctj tm J.uic I uKhfiKo «M al . l:».nlo;!K;tl .Soi icty of AnicriLii. " llic Sustainahlc BmsphiTi; Iniliativc An litological 
k«'sc;ifth Agenda. * (trait iltKUincni. Oct ^0. I*/K) 

^f-or iKm;uK oti iIjc Irayilc process by whuli the Scxuty s 2.(XX) inofuhcni and its Iciulcrs rciichciJ consensus, sec IHiz-abcth I'crmisi. 
*'l Aolo>f> Sntit. !) Kc;il Iil-s k.ifi* ( OnsefLSu.s on Res<MjLh Agenda/' Ihv Stienn.u, vol 4. No 17. Scpi ^. I WO. pp 3. 9. 20 

Mhul . p ^ 

I'o l:iki» ;iru)lhcr I'x.unplc. ihc vistrfinoiin conummuy. wurkirij; through (he N.ihor»al Academy of Sc iences, has issued fmir decHiuil surveys 
<d ihe licid l-or Ihe latest, see Nalioii.il Av adeniy <if Sciences. A Dvi luicnf PtAnnrn tn A\trttnnm^ arui AstrophysuK (Washington. IK'- Nattonal 
Aiadcniv f*tess. IWI >. .uid ihe sialenicni (d llie slud> tonnnatee ihaarnan. iohii N Haiu all. **l*niuui/inx Scientific Initiatives.*' .Vt ienii\ vol 
J^l. Mar :i. iWM. pp I4U> 141^ 
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Figure 5-2— Distribution of Federal Support of Neurosclence Research: 

FIsdal Year 1990 




KEY: NlH«National InbtivulM of Health; AOAMHA-Aloohol, Drug Abust, isnd Mtntal Htaith Admlnial ration; 
N!NO$«NAllonal instituta of Naurologlcai Oisordari and Stroka; NIAuNatlonai loatltuta on Aging; NEUNational 
Eya Infltituta, NiDOCD»National Instituta on Oaafnaai and 0*h«r Communication Obordara; NtCHD-Natlonal 
Inslituta on Child Haaith and Human Davalcpmant; NIEHS-Natlonai Inatltuta of Envlronmantal Haalth Sciancas; 
NlMH«Natlonalln$tituta ofMantai Haalth;NIOA«Nationai Inatltuta onOrugAbusaiNIAAA-Natlonal Inttltutaon 
Alcohol Abuaa and Alcoholism; VA.U.S. Dapartmant of Vatarana Affaira; NSF-iNatfonal Scianca Foundation; 
DOD.U.S. Dapartmant of Dafanaa; DOEi-U.S. Dapartnoant of Enargy; Othar-Natlonat Inititula on Oiaablllty and 
Rehabilitation Raaaarch. National Aaronautlca and Spaca Admlnittratton. Env<ronmaotal Protadlon Agancy. 
U.S. Dapartmant of Agricultura, Cantara for Ditaosa Control, and Food and Drug Admlniatratlon. 

SOURCE : Off lea of Tachnology Aasaumant. basad on astlmata« In Elizabath Pannlil arKi Diana Morgan. " Sraln 
DacQda' Nauroscianttsts Court Support." TTra Sd^ntisi, vo(. 4, No. 21. Oct. 29. 1090. p. 8. 



neering, and Technology committee is constituted to 
coordinate among relevant funding organizations, 
aligning scientific priorities with budgets would be 
unlikely. 

At the program level, few projects will influence 
the trajectories of science one way or another. A 
question, then, is whether agency administrators can 



select streams of projects, or portfolios, that result 
collectively in new knowledge (i.e., having reasona- 
ble technical merit) or produce social and economic 
benefits beyond cosis.^ Put another way, funding 
research can be compared to placing money in the 
Slock market. The more diverse and strong one's 
portfolio of accounts, the greater the chance of 



^Tljc following is based on Harvey Avcrcti. "Analyzing the Cus(5 oi Federal Research/* OTA contractor report, August 1990. Available lliiough 
tlie Naliuuai Ibchnical Infofmation Service, sec app. F. 
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250^271, 



success. But the metaphor brciiks down here Ixj- 
cause, while success in slock nuu"kei invesiinenls 
can be gauged by money eiuned, nothing as imigible 
results from resciirch— at least not in the short run.-^"^ 

A program * 'purchases" a portfolio of reseiu'ch 
projects in a tield. T\\c selection of projects for 
inclusion in this portfolio has Ix^en determined by 
their predicted or estimated quality as seen by 
contemporcU*y research perfomiers (reviewers) or by 
knowledgeable research ni;uiagers (with or without 
the ttid of reviewers). Reviewers usually make 
judgments about llie quality of a [>roject without ;uiy 



direct comparisons of the alteniatives facing llie 
investor. Priority setting forces such compaiisons. 
Rather than choosing projects on a one-by-one basis 
up to the fX3int of resource exhaustion, they could be 
recommended with reference to their incremental 
value, i.e., as projects that concentrate or diversify 
slrengtli in tlie }X)rtfolio. Managers, on the other 
hand, compare projects with reference to the objec- 
tives of tlie entire program portfolio. 

At least for basic research, researchers, reviewers, 
;uid program managers are supposed to adjust their 
activities so quickly that judgments about the quality 



ERIC 



*''Si*f Marvi-y Avt»n h. '\Ni'\v rcMHulaiious Im Si icik v diu\ li\ hnolnj^y I'oln. y Au.il) mv,** [);ifHT prcsciilcd al the C *imK*ri.*ncc un Ihi* Mutual Hi'U'vaiicc 
i)| SoiMKO Studies ami Sviciur Polu). May I?. h^X*>. p 7 
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until 1982, when its funding jumped up substantially. NSF supports mostly basic research not tied to missions or 
applications in a full range of computer science and oigineering subdisciplines, including theory, software systems 
and engineering, aitif ical intelligence and robc^cs, and advanced computer architecture. The Department of Energy 
(DOE) involvement in computers dates back to ENIAC in 1945, which was used for calculations for nuclear bomb 
research at the Los Alamos National Laboratory. DOE (and its predecessor agencies, the Atomic Energy 
Commission and the Energy Research and Development Administration) has been a maiot force in the development 
of high-performance scientific supeicomputers ever since.^ 

Federal funding for academic computer science research rose dramatically between 1976 and 1989, from over 
$27 million to $235 million (current dollars), or 320 percent in real terms. DOD, NSF, NASA, and DOE account 
for virtually all Federal funding of academic research in computer science. (The National Institutes of Health and 
the National Institute of Standards and Tbchnology both allocate a small number of extramural contracts and grants 
to universities and colleges.) 

DOD has historically been the largest funder of academic computer science and its role increased substantially 
since 1976. DOD*s share of Federal funding for academic computer science rose from 45 percent to 62 percent in 
fiscal years 1976 to 1989, accounting for over two-thirds of the total increase in this funding during this period. 
Although NSF funding for academic computer science increased from rouglily $14 million to $64 million (current) 
between fiscal years 1976 and 1989— a real growth of 126 percent— its share of total Federal support for academic 
computer science declined from 51 percent to 27 percent. 

Policy Initiatives in Computer Science Research 

Policy initiatives from the Federal Coordinating Council on Science, Engineering, and Tfechnology (FCCSET) 
and the Computer Science and Technology Board of the National Research Council call for substantial funding 
increases in high-performance computing. The FCCSET proposal has already led to a multiagency requitst for a 
$149 million funding augmentation (in what is now called the High Performance Computing and Communications 
Program), and to new joint Defense Advanced Research Projects Agency-NSF projects.^ The question of balance 
and priorities— the shape of the Federal research portfolio for computer science— is likely to persist well into the 



^Kcnncih Flamm, Targeting the Computer OVwhington, DC: The Brookings Instiluiton, 1987). pp. 78-85. 

^NalioMl Science FouudaHon, Committee on Phyiical, \fatbematicAl. and Engioeerim Scieocef . Gratd Challenges: High Performance 
Computing and Communications (Washington, DC: Pfebniary 199 1 ); Executive Office of the Prtiident, Office of Science and Ibchnology Policy. 
"A Research and Development Suiiegy for High Performance Computing/' unpublished docomeni, Nov. 20. 1987; and National Science 
Foundation. • *Cf osswalk of NSP Research Related to the Department of Cominctce Bmetging Tbchnologics Liu and the Department of Defense 
Critical Tbchnologies List/* in "Background Material for Long-Rtnge Planning: 1992-1996." prepared for a meeUng of the National Science 
Board, June H-15. 1990, pp. B-1 to E-6. 

^For a ''call to action* * to computing researchers, see Ifcny M. Walker, "Innuencing FedenU Support for Computing Research." 
Computing Research News. vol. 2. July 1990, pp. 1. 10-11 . i- 



of any isolated single project remain congruent with 
dcvelopnienls at the frontiers of knov/ledge. In 
practice, the agency investor has no way of knowing 
whether this invisible hand'' is efficient, rapid, iuid 
has good discriminating power. So portfolio evalua- 
tions could be used to set relative investment 
priorities since they provide a check on performance 
at a useful level of budgetary aggregation. But this 
would require some modification of the criteria for 
project selection. Reviewers would no longer be 
ranking proposals by scientific iiierit alone, but with 
respect to standards about which they as experts 
have no sj>ecial i-ompcleiice. i.e.. issues of social 
merit. 



The burden for priorities, then, rests not with 
those who give advice, but with those who receive 
iuid sort it along with other program and agency 
objectives. To take an example, for the period 1987 
to 1991 at NSF, the increase in appropriations for 
"research and related activities*' directorates 
(R&RA) was 39 [xjrcent to $1.93 billion (in current 
dolliirs). Tliis compiires to a l!53-percent increase in 
"science and engineering education'' to $2.S1 mil- 
lion ;md a 49-percent increase for the U.S. Antarctic 
Program to $175 million. Looked at thematically. 80 
[>crcentofthe requested fiscal year 1991 NSFbudget 
was for resciirch and facilities, imd 20 percent for 
education and human resources (a virtual doubling 
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Table 5-5— Inhouse Evaluation for the NSF Strategic Plan: Research Advances and Opportunities 
Lost or Postponed, Research and Related Directorates, Fiscal Years 1987-90 



Percent change 
In funding 
Directorate (c urrent dollars) 

All Research and 
Related 
DIrectoirates 



Research advances 



Opportunities 
lost/postponed 



39.0% 



Biological. 26.3 
Behavioral, 
and Social 
Sciences 

Computer and 65.5 
infornriatlon 
Science and 
Engineering 



Engineering 39.5 



Gooscionces 34.8 



Mathematical 34.1 
and Physical 
Sciences 



Scientific, Tech- 69.0 
nological, and 
International 
Affairs 



• Research Initiatives to enhance economic 
competitiveness In biotechnology, global change, manu- 
facturing, materials, supercomputlng/networking, 
superconductivity. 

• 10 new ERCs, 1 1 new STCs. 

• ProgramsonwonDen/mlnorltles/dlsabledandundergradu- 
ate research and teaching expanded. 

• Number of proposals up 1 1 .2 percent; number of awards 
up 4.6 percent. 

• 5 new centers (3 In biotechnology. 1 1n plant science — 
cooperatively with DOE and USDA. and 1 1n geography). 

• Other Initiatives In neurobiology, human dimensions in 
global environment change. 

• Equipment and Instrunrientatlon increases. 

• NSFNET expansion. 

• New joint initiative with DARPA In parallel processing. 

• 4 supercomputer centers renewed. 

• Infrastructure activities In minority institutions. 



Decline of 6.1 percent In proposal 
success rates and In average 
annualized award amounts In 
5 of 6 directorates (1987-69). 
3 ERCs and 5 materials research 
labs terminated. 
Other STCs deferred. 



• Pursued ail proposed, but at 
reduced levels. 

• 3-percent decline In proposal 
success rates. 



7 group research grants for Strategic Manufacturing 
Initiative. 

New initiatives In optical communications, nondestructive 
evaluation, and management of technology. 

Research on Loma Prieta Earthquake, 
initiated active Systems Service. 



• Major research equipment subactivlty for large research 
equipment construction projects. 

• Augmented support for new investigators. 



• Growth of EPSCoR. 

• Implementation of Scientific and lochnlcal Personnel 
Data System. 

• 6 Minority Research Centers of Excellence initiated. 



• 27-percent decline In success rates. 

• Fewer grants to groups than 
planned. 

• Software engineering initiative 
delayed. 

• 1 supercomputer center phased out. 

• Number of proposals and awards 
down slightly. 

• Materials synthesis and processing 
initiative (with MPS) delayed. 

• Success rates down 3.2 percent. 

• Canceled some atmospheric 
science filed programs. 

• New Initiative In mesoscale 
meteorology defet rod. 

• Success rates down 1 3.9 percent. 

• Illinois Macrotron construction 
canceled. 

• Material synthesis and processing 
initiative postponed. 

• Success rate down 9.2 percent. 

• Undergraduate Education Data 
System In SRS delayod. 



KEY: DARPA-Dotense Advanced Rdsoarch Projects Agency; DOE-U.S. Departmont of Energy; EPSCoR-Experimentel Program to Stimulate Competitive 
Research; ERC-Engineering Research Centers; MPS-Mathematical and Physical Sciences; NSF^O'-Natlonal Sci«rK;e Foundation eiectronic 
network; SRS-Science Resources Studies; STC-Science and Technoiogy Centers; USDA-U.S. Deparlment of Agriculture. 

SOURCE: National Scierx^e Foundation. "Background Matorial for Loxig-Range Planning: 1992-1996." NSB 90-61. prepared tor a rneeting of the National 
Science Board, June 14-1&. 1990. pp. C-3 to C I 7. 



from its share in fiscal year 1987). Tliis reflects the 
congressionally iniuuialed priority of science educa- 
tion at NSF.^" 

Table 5-5 highlights research advances in its 
R&RA diicctorates since 1987. as well as research 



opportunities seen as lost or postponed. This inhouse 
evaluation was provided to the National wScience 
Hoiird to assist in its long-temi planning. It could 
also serve as a tool for organization and reorganiza- 
tion (see box 5-F), and as a priority scorecard for the 
mostly little science that NSF supports. 



^•'Hr'Sc pcrc'cnugcs and amouni.s iitc huscd on requests in the fisciil yc;if 1 1 hudgcl. Slill. ihcy appt oximalc how Ihc research dircctoraics have fared 
relative lo other aciivifics at ihe National Science f-uundalion. Sec National Scicinre Foundation. "Background Material for Loug-Raiigc Planning. 
I992-im/* NSB 9(VKi. prepared for a mcehng of the Naliofial Science Board. June 14-15. 1990. p. C-3. 

^•'llie Ankirctic Progriun is the chief exccplioiu though the National Science I nundation also funds research and development centers such as the 
National C enlef for Atmospheric Research, the Km Peak and (Jreen Bank telescopes, and five National Supercomputer Centers. 
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Box 5-F— Behavioral and Social Sciences: Organization and Federal Funding 

In the concludifig chapter of a National Research Council (NRC) committee report on achievements and 
opportunities in the behavioral and social sciences, titled "Raising tlie Scientific Yield." a prescription is offered 
for **. . . new investments and modifications in research infrastructures that are needed for further progress."* The 
program of prescribed investments total $240 million annually in 1987. a year in which Federal expenditures on 
behavioral and social sciences research reached the $780 million mark.^ The research frontiers singled out by the 
NRC committee for investment include "... new inquiries into the connections among behavior, mind, and 
brain, . , ." ". . . rc!>-5arcli on the mechanisms of choice and allocation. . . ". . . comparative and historic J 
(including prehistorii-rd) study of the institutional and cultural origins of entire societies, ..." and methodological 
adv;uices in ". . . data collection, representation, and analysis."^ But is the level of Federal investment 'h\ a broad 
field of science indicative of its potential contributions? 

The behavioral imd social sciences tend to get less visibility than other sciences at the Federal agencies, 
especially the National Science Foundation (NSIO and the Alcohol. Dnig Abuse, and Mental Health Administration 
(ADAMHA) of the Department of Health and Human Services, which are the primary providers of basic research 
funding. This dilemma was addressed at a Senate hearing in 1989 by the economist-psychologist and Nobel laureate 
Herbert Simon. 

It is misleading to talk about "hard'' and *Vsoft sciences. In the physical sciences, classical mechanics is hard, 
but meteorology (e.g.. the greenhouse effect) and the theory of high-temperature superconductivity or low- 
temperature fiision can be (as recent news stories tell us) exceedingly soft. Similarly, in the social sciences, knowledge 
about the operation of competitive markets or the capacity of human short-temi memory is quite hard; but knowledge 
about how businessmen iuid consumers form expectations about the future, or about motivations surrounding dnig 
usage can be quite soft.** 

To study scientifically what makes us human is as daunting a task as to discover the fundamental forces of tlie 
universe or to understand how normal cells become factories of disease.' The problem is the priority of funding 
social research, and opinions may differ on how to institutionalize a Federal commitment to behavioral and social 
science research. 

An Organizational Soh^tion? 

In August 1990, Reps. Walgren and Brown introduced H.R. 5543. The Behavioral and Social Science 
Directorate Act of 1990, This was proposed because, according to Walgren: ''NSF's enthusiasm for the behavioral 
and social sciences is at best lukewarm ... and the cause is largely structural. Since its cre<ition, this Biological, 
Behavioral, and Social Science (BBS) Directorate has been headed by a biologist." Brown added that: '^NSF as 
a whole has enjoyed a relatively large increa.se in funding over the past decade. . . . However, rather ilian sharing 
in the Foundation's good fortune, these areas of science have been languishing."^ Tlie current BBS budget totals 
$293 million, including $48 niillion for "bcluivioral and neural sciences' ' and $33 million for ' 'social and economic 
sciences."' 

While the concept of a separate directorate has been around for at lea.st a decade — the time of Reagrm-era 
cuts— at the 1990 National Behavioral Science Summit, held under the auspices of the American Psychological 
Society. 65 psychological and bchn . /.nal science organi/ai.ons endorsed the idea as a solution to needed visibility 



*I>can R. Gcrslcin o! al (eds ). The Betumoral and Social S Itnces: Achievements and Opportunities (Washiaglon. DC: National 
Afadcmy Press, h>8K), p 23V. 

^Ibid, p. 249 

^Ibid.. pp. 239-244 

■^Herbert Simon. tcsinnon> . m I ' S Ci)iigic?iS. Sciwic (.'oiiJinillcc on Commerce, Science, .-uid TraiLspoilation. Sulx'ominillce qu ^ icnce, 
Tbclinology. and Space, National Snent e and TechnoloKy Policy. Sept. 28-29» 1989, lOUt Cong. (Wnshiiigton. DC: U.S. CjovcrtiiiHjm PriutiUM 
Oflicc. 1989). pp. 2M'269 

^'Ihis was furm.ill> Tccn>;ni/cd when ihe orRurnc *kI the Natjon»il Science Foundation was ajnendcd in 1%8. placing within its legal | 
maridatc " . a fonnal rcspon^jbihty to look after the health of K^sic research m the social and bcliavioral .sciences " Sec Rotter ta Hnlslad ?.!:llcr. ' 
National Science I'oundaiinn, * "Ibc ( 'r'niribuiioi. of SiKial Research." John Madge MemoriaJ l^ecturc, Londoji School oi l^vtuiomics. Novciidnrf ^ 
1 980. tpjotc trorii p f^ ! 
[ ^"Behavioral l)iiciiof:iio tor SSI' l*ropnsrd ;n Congress." Af'S Oh.wnrr, vol ^, .Septcrnl)cr I99(). p 7 

J ^**S(»ci.'U. HL-haviD/.i! ^v icolos Seek I p^ratJe NSI'." .S< ir/itf ti (lo\Cfnmem Repi>rt. vol 20, No. 15. (kt I. I9M). p (> 

j Continued on noxt page 
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Box 5»F— Behavioral and Social Sciences: Organization and Federal Funding-Continued 

and bigger budgets.* NSF appointed a task force on ^'Looking to the Twenty-Fint Century'' to study the idea and 
"... keep several thoughts in mind: 1) BBS must have the flexibility to meet new mandates; 2) BBS must meet 
the infrastructure needs of its disciplines; and 3) the zero-sum budget situaticm makes fimding reallocations 
difficult."^ 

In December 1990i the Uisk force voted its Intention to reconunend establishing a separate NSF directorate for 
social and behavioral sciences. It would be called Social, Economic, and Psychological Sciences (SEPS).^^ 
Foremost among the issues the task force must ccmsider are how the boundaries for the behavioral scimces would 
be drawn, and how interdisciplinary research would be affected Recommended for inclusion in SEPS are 
economics, geography, law, linguistics, political science, psychology, and sociology. The interdisciplinary fields 
of cognitive science and of decision, risk, and management sciences would also be included. Most of neuroscience 
would stay in the biological directorate. Umesolved are the place of anthropology and some of the programs 
supporting research on information, robotics, and intelligent systems (now housed in the Computer and Information 
Science and Engineering Directorate).^^ In lieu of immediately developing a divisional or progranunatic stmcture 
for SEPS, a new group (including NSF program officers) may be asked to takt up the issue. 

Whether a separate directorate could aid the management and funding of social and behavioral science research 
at NSF, and how the agency could assess the effectiveness or productivity of such a new directorate, remains to be 
seen. Implementation of whatever is finally approved would not occur until fiscal year 1993. It is clear that advocates 
in the vast majority of behavioral and social science fields (led by psychology) are convinced that . . only by 
elevating representation of our scientific disciplines will we successfully compete and increase our funding 
capabilities and our potential c<mtributions to science. "^^ 



*Tbe question of political vuloenbility (hat accompanies a coitsolictatioo of inrerests in a single stmcture is tbe flip side of political gain. 
For eiuunple, coocero for ibc eavkoomental sciences has led to a call for Coogrea to create a new agency, tbe Naikmal Institutes for the 
Environment (NIE), modeled oo the National Institutes of Health, to stop the erosion of research and tnUnlng pn9gnuna related to cDvironmental 
biology, economics, and policy. Congress has asked the National Acadmy of Sciences to study the concept of an NIB. See Henry F. Howe and 
Siephoi P. Hubbell, "Progress Re^^rt on Proposed National Instimtes for tbe Environment," BhScienee, vol. 40, No, 8, September 1990, p. 
567; and William Booth, '*Ooes Earth Need a Government Institute?" Tht Wasktngm Post, Dec. 10, 1990. p. AI3. 

^"BBS Jksk Force Mc^s: Separate Directorate Issue cm Ihe 1U)te," COSSA Washingm Update, Sept. 21, 1990, p. 1 . 

l<>rbe final report of the task force is forthcoming. See "NSF Tuk Force to Recommend New Directorate for Social and Behavioral 
Sciences/' COSSA Washington Update, Dec. 7, 1990, pp. 1-2; and "NSF Task Force Discusses Upcoming Repoit. A^tes to Suppoit SEPS 
Directorate," COSSA Washington Update, Jan. 28, 199l, pp. 1-2. 

^Anthropology opposes the creation of a new directorate, but the American Anlhropologtcal Association baa announced that: "Were 
the proposed reorganization to occur, (anthropology] would elect to be boused ..." in it. See "Anttarqpok>glsfs Opt for SEPS Diitctorate,*' 
COSSA Washington Update, Feb. 10, 1991, p. 2. Applied suttistics, ". . . measurement md metbodologtcal research, as well as Infrastructurc 
issues ..." are favored by the task force to join the Social. Economic and Psychological Sciences as well. See "NSF Tkak Votce Discusses 
Upcoming Report.** op. cit., foomote 10, pp. 1-2. 

^ Quoted from tbe Amoican Psychological Association in * *NSF Tsdk Force to Recommend New Directorate for octal and Behavioral 
.Science:^." op. cit.. footnote 10, p. 1. Also see Alan G. Kraut, "Statement of tbe American Psychological Society to tbe National Science 
Foundation's BBS 'Huk Force on Linking to the 21st Century," unpublished document, Nov. 29, 1990. 



'nie science base, especially ai NSF and NIM, 
carries iu)l only the traditional responsibility for 
funding scientifically meritorious research, but also 
for salisfyin^z the expectations that the |X)litical 
system associates with the support of research. 
Thesf ex{>eciaiions. together with budget con- 
slrainis, create tougher and tougher choices Tlie 
agencies cofv admirably with this ciniiplox ta.sk. In 
the next sectiot^ i)TA exiuinncs another category ot 
resciirch funding: science rnegajirojects. 



Science Megaprojects 

The FederrJ Government has a long history of 
supporting projects such as the building and opera- 
tion of dams, bridges, luid tnmsportation systems. 
ITiCse projects iue hirge-scale, complex, costly, and 
long-term undertakings. In addition to {)erforming 
their prinuuy function, these programs also provide 
jobs and local public works, and have long-term 
economic value, llius, they ore often called ^^tnega- 
[nojects/* 
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As the body of scientific knowledge grows more 
sophisticated and costly, research instrumentation 
and infrastructure are required in some fields.^^ As 
projects expand, they become valuable econom- 
ically and politically. For example, the Hubble 
Space Iblescope, launched in April 1990, cost over 
$2 billion, although the original estimate was as low 
as $300 million* 

By the time the real costs were known, it was too 
far along to stop. As a practical matt^, Congress 
refused to write off as wasted the hundreds of 
millions it already had sunk into the project. 
Politically, the device had taken on a pork-barrel life 
of Us own, sending government money to nearly half 
the 50 States and employing thousands.^^ 

Although economic activity may be a second- or 
third-order consideration among the initial criteria 
of project selection, the distribution of Federal 
monies, as an interim payoff on a long-term invest- 
ment, can be substantial. For instance, the three 
megaprojects shown in figure 5-3, the Hubble Space 
Iblescope, the Space Station, and the SSC, enjoy 
widespread economic and social merits, regardless 
of their scientific merit. 

Among the megaprojects recently listed by The 
Chronicle of Higher Education are the SSC, the 
Space Station, the Moon-Mars mission, the hyper- 
sonic aircraft, the Earth Observing System, the 
Strategic Defense Initiative, and the Human 
Genome Project (HOP). The original estimates for 
these seven projects alone totaled $528 billion. A 
September 1990 cost estimate for the same projects 
was about $580 billion,^ or $65 billion annually ' 



Phc(o er^dH: US. O^pmtnmf d Ermgy 

Each of these lines Is a trace of the path of a subatomic 
partlde. This picture Is an example of the Mntt of data that 
can only t>e produced by the Superconducting Super 
Collider (SSC). The SSC Is expeoted to produce traces 
of partldes never seen More, 

What Constitutes a Science Megaproject? 

Megaprojects are large, lumpy, and uncertain in 
outcomes and cost. '*Lumpy'* refers to the discrete 
nature of a project. Unlike little science projects, 
there can be no information output from a megaproj- 
ect until some large-scale investment has occurred,^^ 
OTA also would defuie a science megaproject as 
requiring very large expenditures (especially when 



^^Onc phi jsophcr argues that ihc further and further wc get iVom direct sense cxp«ience. the more costly and complex research technologies wc need 
for progress. Sec Nicho!i« Reseller, Scientific Progress: A Philosophical Essay on she Economics of Research in Natural Science (Pittsburgh, PA: 
University of Pittsburgh Press, 1978). The section below is based on Avcrch, op. cit., footnote 28. 

"Phil Kuntz, "Pie in iliC Sky: Big Science Is Ready for Blastoff," Congressional Quarterly, vol. 48. Apr. 28. 1990. p. 1254, Also see Kim A. 
McDonald, "Resetrchers Increasingly Worried About the UnrcUability of Big Science Projecis." The Chronicle of Higher Education, vol 36. No. 48. 
Aug. 15, 1990, '^p Al. AS*A9. 

**Collecn Lordcs. "Big Science and Thclinology Projects Near Important Milestones in Puce of Federal Budget Cnmch and Mounting Criticism," 
'The Chronicle of Higher Education, vol 37. No. 2, Sept. 12, 1990. p A28. reports original and cuncnt cost estimates submitted to Congress Just for 
^ic RScD investments required for tlic seven projects (most not adjusted for inflation). High- technology RStD project cost estimates are notoriously (but 
ijnsurprisingly) low. For exaniple. a number of RAND Corp. studies show the underestimation in the actual costs to develop high-tech miliiary aircraft. 
Scw P.W.G. Morris and G.H. Hough. The Anatomy of Major Project.i: A Study of the Reality of Project Management (New York, NY: John Wiley ^ 
Sous, 1987). 

3*Sce "Big Science: Is It Worth the I^ricc?" The New York Times. May 27, 1990. p. 11. and June 5, 1990. p CI. 

^Il is rwi possible to build one-lialf of a dam. one-half of a ship, or one-hidf of an airplane and cet the desired performance. These technologies arc, 
of course, well enough in hand that one can estimate or predict the resulls from investing in tljem. There is a very extcasivc literature on appraisal and 
miuiagefivcnl of capital projects such its dams. ai. ports, ports, and also a sizable literature on estimating the worth of private sector capital uivesinjcnts 
in factories and e*iuipincn!. Among the literature on managirig large complex technological systems, literally nothing is written on selecting ihcnj. Hut 
see Harvey Sapolsky, The Polaris System Development. Bureaucratic Success m Gov^-rnment (Cambridge. MA: Harvard University I'ress, 1972). 



Figure 5-3— Where the Money Goes for Three Megaprojects 




SOURCE: Map by Sharon PafWn*on in Phil KunU. "Pit in th« Sky; BI9 Science !• Rwdy for Blaatof)." Congrasalona] Quarterly W0tidy Rtpcrt. vol. 4S, Apr. 28. 1990. p. 1255. 
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compared with otner investments in the same or 
similar fields) to create knowledge that is unattaina- 
ble by any other means. 

Perhaps equally important in the defmition of 
science megaprojects, however, are the political 
components. Each project is unique in its develop- 
ment, especially in its progress through the budget 
processes at the research agencies. Also, science 
megaprojects are supported by large political con- 
stituencies extending beyond the scientific commu- 
nity. In short, there are few rules for selecting and 
funding science megaprojects; the process is largely 
ad hoc. Tb illustrate, OTA presents two widely 
acknowledged examples of big science projects — 
the SSC aiui the HOP. 

The Superconducting Super Collider 

The SSC, when built, will accelerate two counter- 
circulating i>eams of protons at energy level 20 TfcV 
to '•create" rarely seen elementary particles when 
these beams coUide. Expected to cost at least $8 
billion to construct, tlie SSC represents one of the 
world's largest scientific instruments.^^ Amidst 
contentious debate in Congress, the SSC won 
funding approval to begin construction in June 1989. 
DOE decided to build the 54-mile-in-circumference 
accelerator south of Dallas, Tbxas; it is expected to 
begin operation in 1999.^^ Director Emeritus of 
Fenni National Accelerator Laboratory, Leon Le- 
derman, has said in House testimony thai . . in- 
stead of trying to kill off a big target like the 
SSC ... the collider should be seen as the 'flagship' 
for big increases for science [funding]. "^^ 



The SSC clearly meets the specific criteria 
outlined by OTA for a big science project (high cost 
and unique outcomes). It also satisfies the political 
criteria. First, the SSC has important scientific goals 
that can be obtained in no other way. Second, the 
high-energy physics community has marshalled 
support of the SSC from DOE, which administers 
the project, and the State of Tbxas, where it will be 
built. Finally, the SSC originated in DOE discus- 
sions with the high-energy physics community, and 
was preferred by the Department's High Energy 
Physics Advisory Panel to the equivalent amount 
invested in smaller, less costly high-energy phys- 
ics.^ As with many big science projects, however, 
it is also true that, without the prospect for such an 
accelerator, the equivalent amount would most 
likely not be available to physicists— or indeed to 
scientists in other fields — at all. 

The Human Genome Project 

The HOP, estimated to cost $3 billion to com- 
plete, is expected to yield a high-quality genetic map 
of the human genome. Tlie HOP is * * big" biology in 
lifetime costs and mode of organization (e.g,, 
scientists clustered in "mapping" centers) relative 
to the rest of biomedicine."** An annual $200 million 
appropriation would represent 5 percent of NlH's 
funding for un targeted re search .^^ Its fiscal year 
1991 appropriation is $135 million. HOP organizers 
stress that Ending for the project since its inception 
has been "new" money. Funds from other budget 
categories at NIH have not shifted to the HOP, i.e., 
none have decreased since the inception of the 
project."*^ 



"Sec David P. Hamillon, "The SSC "Mcs On a Life of lis Own,'* Science, vol. 249. Aug. 17, 1990, pp, 731-732; and Marcia Barinaga. "Tbc SSC 
Gets lui (OmciaJ) Price Tag: $8.3 Billion/' Science, vol. 251. Feb. 15. 1991. pp. 741-742. 

^Scc U S. Dcpartraeni of Energy. C>fficc of the Inspccior OcocraU Special Report on the Department of Energy' s Superconducting Super Collider 
Program. DOE;IG-029| (Ocnnan'own, Ml): Nov. 16. 1990). 

'^Quoted in Colleen Cordes. "CMU for Setting Science-Spending Priwincs Are Renewed as Supercollider Gets Go-Ahead, NSF Faces Pinch/' The 
Chronicle of Higher Fducation. vol 35, No, 46. July 26. 1989. p. A23. Notice the tradeoff language in the headline. 

^^phng 1990. IheDcpamneniofEnergy'sHigh^rg:/ Physics Advisory Panel rankcdrescarchgoalsfor the 1990$: building the Supcfconducling 
Super Collider (SSC) was flni, upgrading Fennilab s proton-proion Ifcvatron collider was second, and supporting univcrsity-bascd investigators 
receivca honorable mention. Sec **Physics Panel Sets Prioiitie* for 1990!i/* Science, vol. 248. May 1 1. 1990. p. 681. This also emerged from OTA staff 
Interviews at the Dcpaitmcni of Encigy, spring 1990, In a January 1991 ucws release, the Council of the American Physical Society, for tbc first time 
in its 93-yeaj hisiory. . . overwhelmingly adopted a public position on ftinding priorities. Tbp priority is given lo support of Individual investigators 
and 'broadly based physics research,' " The sutement also endorses constniction of the StSClna". . . timely fashion, but the funding required to achieve 
this goal mtist no! be at the expense of the broadly based scientinc rej;earch program of the United Sutes.* ' See American Physical Society, *'Firsi APS 
Council Statement on Funding Priorities." news n^lcase. Jan. 28. 1991. 

^^TomSboop. "Biology** Moon Shot/' G over ftment Executive. February 1991. pp. 10-11. 13. 16-17. 

^^In fiscal year 1990. \\\t Human (icnome Project i.? budgeted for $90 million at the National lw;urutes of Health (Nlil) and $46 million at tbc 
Department of Rnrrgy. The NTH amount reprcscnls 1 peic«ui of itr> ioial budget Sw* Leslie Roberts. "A Meeting of the Minds on the Genome Project?' * 
Science, vol. 250. Nov. 9. 1990, pp 15(^1^1. 

*^Stu flormaii, ^'HumaiJ Genome Projeci Moving on Many Fronts." Chemical & Engineering News. vol. 68. No. 50. Dec. 10. 1990. pp. 6-7. 
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Critics of the HGP contend that it flaunts tradition 
in the administration and performance of biomedical 
research. They are also ' \ • • not convinced that a 
crash program for analyzing the structure of 
genomes will advance either health or the life 
sciences for many years to come."^ Proponents of 
the project stress its development of automated 
technologies for molecular biology, including map- 
ping and sequencing, and of new computational 
approaches that apply computer science to biology. 
Thus, . . a new type of interdisciplinary biologist 
who understands technology as well as biology . . * 
is being trained. Besides, in the words of molecular 
biologist Leroy Hood: 

The HGP primarily funds single investigator- 
sponsored research. It is not big science. Rather, by 
making the human chromosomal map and sequence 
available to small laboratories, it allows them to 
compete with large laboratories. Hence, the HGP is 
the guarantor of small science/^ 

The HGP was originally billed as a project that 
would contribute to the cures for all disease.^ As 
legislators skeptically claimed that they had heard 
this * 'promise" from life science projects before, 
proponents of the project began to promote the HGP 
on its otlier potential strengths, including contribu- 
tions to economic competitiveness. For instance, 
Hood stated that HGP will in turn spawn new 

industrial opportunities The HGP will prime tlie 

American economic pump."^^ 

At issue in the designation of this science project 
as **big" is more than cost and organization, but the 
timing of the research investment and its impact on 
both the culture and justification for biomedical 



research. The 1 percent of NlH's budget is a small 
investment, but it represents the reordering of 
criteria and the disruption of research-as-usual. 



The Process of Megaproject Selection 

From a national perspective, megaprojects are 
very large projects that stand alone in the Federal 
budget and cannot be subject to priority setting 
within a single agency. Nor can megaprojects be 
readily compared. The SSC and HGP are not big 
science in the same sense. One involves construction 
of a large instrument, while the other is a collection 
of small projects. There also exists virtually no 
scholarly literature to guide the selection of mega- 
jn'ojects designed to promote the state of the art of 
scientific fields.^ At issue with many megaprojects 
is their contribution to science. For instance, the 
Space Station has little justification on scientific 
grounds,^^ especially when compared with the SSC 
or the Earth Observing System, which have explicit 
scientific rationales. At present, the Space Station 
does have considerable momentum as an economic 
and social project.^^ However, many question the 
uniqueness of these benefits because other projects, 
such as the Earth Observing System, could certainly 
provide many jobs as well. Because the problem of 
selecting among science megaprojects has most in 
common with the selection of complex capital 
projects, timeliness (why do it now rather than 
later?) and scientific and social merit must all be 
considered. 

The tradeoffs among these criteria are complex, 
even when restricted to considerations solely within 



**Bcmard D. Davis. * 'Human Genome Project: Is 'Big Science' Bud for Biology?-- Yes: It Bureaucraii/cs, PoliUcizcs Research," The Scientist, vol 
4, No. 22. Nov. 12. 1990. p. 15. 

<3Leroy E Hood. "Human Genome Project: Is "Big Science' Bad for Biology?- No: And Anyway, the HGP Isn't 'Big Science.* " The Scientist, 
vol. 4, No. 22. Nov. 12. 1990. p. 15. For an elaboration, see Waller Gilbert '^Towwds A Paradigm Shift in Biology." Namre, vol. 349. Jan. 10. 1991. 
p. 99. 

"^See U.S. Congress. Office of Technology Assessment, Mapping Our Genes: Genome Projects— tiow Big, How Fast? OTA-BA-373 (Washington, 
DC: U S Government Prmting Office. April I988i. 
^^Hw)d. op. cii., footnote 45, p. 13. 

■<^The journal Technology m Society devoted one full issue in 1988 and another in 1990 to the political and social consequences of large technological 
projects, but no auUior discussed algorithms for selecting them. Also sec William C. Bocsman. "Historical Perspective on l^ge U.S. Science Facihlies." 
CRS Review, February 1988. pp. 810; ajid Peter Monaghan, "Historians Seek More Detailed Study of Big Science Projects to Inform Debate Among 
Researchers and Policy Makers." The Chronicle of Higher Education, vol. 37. No. 14. Dec. 5. 1990. pp. A5, A8. 

^^For an early statement of this view, see U.S. Congress. Office of Technology Assessment. Civilian Space Stations and the V S. Future in Space 
(Springfield. VA: National Technical Infoniwtion Service. November 1984). 

*^liis momentum may be slowed by the latest siatcmcni of "no confidence" ui the scientific content of Space Station Freedom in a forthcoming 
National Academy of Sciences report See David P flamilton. "Space Station Shniik;ige lb Affect Scientific Mission.' * Science, vol. 251 . Mar, 8, 1991, 
p 1 167; and Eliot Marshall. "Two Tliumbs Down for Space Station." Science, vol. 251. Mar. 22, l99l. p. 1421. 
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In the early stages of megaproject development, it Is often difficult to obtain firm estimates of cost because plans can change 
radically. In 1 982, the Earth Observing System (EOS) was conceived as a large space antenna system, as in the artist's rendering 
on the left. By 1 990, the conception of EOS had changed to Include "'platforms'' in space and other features, as shown on the right. 



tlie scientific community. One observer puts the 
dilemma of weighing social and scientific merit this 
way: 

Scientific progress depends heavily on scientific 
capital; scientific capital is built up by investments 
in trainijig, equipment, pilot research, and the 
accumulation of expertise over extended periods, A 
single very large project may have great scientific 
and social benefits, but if it can be done cmly by 
shutting down existing lines of research in other 
areas, the opportunity losses — the loss of tlie bene- 
fits these lines of research would have produced, plus 
the cost of duplicating in the future the capital 
investments in them — can outweigh the gains from 
the larger project. It is very difficult to estimate the 
losses from opportunities foregone; however, we do 
know that a small proportion of studies trigger the 
kind of dramatic breakthroughs that transform life in 
ways the original researchers themselves rarely 
envision,^ ^ 

In addition, funds are still obligated to agencies. So 
assurances notwithstanding, the research commu- 
nity perceives megaprojects as new money for an 



initiative that could supplant older, S&T base 
programs, and would be added to agency budgets if 
the megaproject did not exist«^^ 

On a national scale, criteria and tradeoffs are even 
more difficult to quantify, since completely separate 
fields arc represented. The social and scientific 
benefits that will derive from investing in one are 
inconunensurable with those that would be derived 
from investing in some other.^^ So weighing the 
scientific, technological, and development benefits 
that will result from the projects will not suffice; 
economic and labor benefits must also be consid- 
ered. Other criteria might also include education and 
training benefits, and the impact of the project on the 
research community measured in per-investigator 
costs. For instance, if one project will benefit only a 
few researchers while a second of similar cost will 
benefit a larger number of researchers, then perhaps 
the second should be favored. 

One might also expect preference for megaproj- 
ects that can be cost-shared internationally over 
those that cannot be. This conceives of megaproject 
output as a contribution to world science, i.e., as 



^^Robcrt L Stoul, "Evaluaiing Scientific InJlialivca/' Icticr, American Scientist, vol 77, No. 3, May-Jimc 1990, pp. 211-212. Ihc opportunities 
presented by megaprojects should be compared with the foregone benefit of little science at the margin, not on average. 

^^This has been ch.vged repeatedly about AIDS funding relative to the rest of the National Institutes of Health budget. For example, see David T. 
Deiihardi, '*lbo Much for AIDS Research," The Washington Post, Oct 2. 1990. p. A19. 

5^See, for example, J. E. Sigel cl ai.. •'Allocating Resources Among AIDS Research Stratcgiai, ' * Policy Sciences, vol. 23, No. I , February 1 990, pp. 
1-23. The authors asked 17 nationally known AIDS experts to estimate the marginal or incremental value of additional funds for difTereoi AIDS research 
investments in terms of some prespecified social outcomes. The information that would be gained from these different investnKnis is incommensurable, 
but their expected contribution to the prc-spccified social outcome allows them to be ordered. The megaproject problem, however, is more like judging 
research investmenu in AIDS v. heart disease v. cancer. 
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Table 5-6— A Comparison of Science Megaprojects (in billlont of dollars) 

Original Most Spent 
cost recent so far Timeframe 
Project estlnrwte estimate (since) (years) 

Hubble Telescope $0.29-0.34 $2 — ' 

(1973) (1978) 

Space Station 8 $37 4 16 

(1983) (1985) 

Superconducting 

Super Collider 4.4 8.6 0.35-0.43 1 1 

(1987) (1988) 

Human Genome 3 3 0.16 15 

(1988) (1988) 

'Project oomplstsd 

NOTE: OrlQinel cost Mtimatst do not Includs inflation, wHis ths r#csnt sstlmatss and tha amount spent ic far Induda 
Inflation. HubM axpandituras Induda davalopmant ($1 .5 billion) and oparating ooata ($0.5 billion), from fiscal 
yaart 107S-1M1. AJI oott astimatas ara roundad. 

SOURCES: Based on Tha Outlook in Congraaa for 7 Major Big Sdanca Projacb," TTia Chronfd^ ofHlghmEduo$tion, 
vol. 37, No. 2. Sept. 1 2. 1990. p. A28: Qanavlava J. Knazo. "Sdenoa Megapro)eota: Statua and Funding. 
Fabaiary iggi," CRS Report for CongrM, 91-26S SPR (Waahlngton. 00: Congraaatonal Rasaafch 
Sarvlca, Mar. 12, 1991); Phil Kuntz, "Pla in tha Sky: Big Sdarm Is Ready for Biastolf.- Congmmtot^ 
Qumfrly W$4kiy Report, vol. 48, Apr. 28. 1990. pp. 1254*1260; and National Aaronauttai and Spaoa 
Administration. OlfkJa of Raiouroas Analysis. Off lea of tha Comptroilar. paraonal oommunlGatk>n. March 
IMI. 

information appropriable by all who want it and can has been made at the national level, the commitment 
benefit. The SSC would not be defined as a is expected to be honored, no matter how much the 
competitor of CERN (the European Organization for cost estimates or timetables for completion change. 
Nuclear Research in Geneva, Switzerland) in some However, criteria for consideration in the funding of 
private particle race pursued by U.S. high-energy a science megaproject could conceivably include: 
physicists; there would also be no national objective startup and operating costs, and likely changes in the 
tokeeptheAmericanrateof discovery above that of overall cost of the project from initial estimate to 
European or Japanese physicists.^ While the pre- completion, liable 5-6 presents a comparison of four 
vailing claim is that "priority races' ' are necessary projects, which shows that the cost estimates for 
to make progress in science, cost- and information- some big science projects double before they are 
sharing are consistent with a view of research as an even begun. 

appropriable, world public good.^^ ^ ^ . . ^ . ^ ^ 

r c» ^^^j^ J presents the budget authonty for four 

While scientific and social merit are abstract, they projects in fiscal years 1990 and 1991. The percent- 
provide a framework to evaluate the merits of age increases requested are considerably larger than 
proposed big science projects. More concrete con- the average annual increase in total budgets pro- 
cerns include the range of megaproject costs and posed for the cognizant research agencies. The costs 
tlieir management. incurred in future years by most megaprojects are 

enormous, and it is unclear that all of the projects 
Megaproject Costs and Management currently receiving funds can be supported in 

coming years. 

The Federal Government buys big science initia- 
tives, and the initial investment may represent a In addition, costs for maintenance of a big science 
point of no return. Once the "go. no-go'* decision facility once it is operational arc rarely considered. 

"Sec S S. Yaxnamoio. "A Genuine Global Partnership?" Nature, vol 346. Aug. 23. 1990. p. 692. Thii has likcwiie been an iisue in the Human 
Genome Project, since J4me$ Waison. Direcior of the National Instituiei of Health'i National Center for Human Genome Research, hai been ouiipoken 
aboul the disappointing level of funding and conuniimcni lo tlic project by the govtnmients of Japan uid France. See Borawm, op. cit.» footnote 43, p, 
7. Also, the benefits of megaprojau include not only the scienUfic knowledge generated, bui the technological know-bow gained in deiignlng and 

buiJding the inscmmentj. 

*^Two liicriiurcs are relevant here. One is on analysis of ' 'simultaneous multiple discoveries' ' and creativity tn icience; the other ii oa dau sharing 
and ihc diffusion of knowledge On the former, see Dean Keith Stmonton, Scientific Oemus ' A Psychology of Science (Cambridge. England: Cambridge 
UnivCTSily Press. 1988); on the latter, see David S. Cordray et al.. "Sharing Research Data: With Whom, When* and How Much?" paper presented at 
the Pubhc Health Service Workslwp on Data Management in Biomedical Research, Chevy Chase. MD. Apr. 25-26. 1990; and Eliot Marshall. "Dau 
Sharing: A Declining Ethic?" Science, vol 248, May 25. 1990. pp. 952. 9.^54^955. 957. 
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Table 5-7— Four "Big Science** Initiatives in the Fiscal Year 1991 Budget 
(estimates In millions of cun^ent dollars) 



Rscal year Rscal year Proposed Rscal year Enacted 



1 990 1 99 1 percent 1 99 1 percent 
Initiativo enacted proposod tncrease enacted ctwnge 

Strategic Defense 

Initiative $3,600 $4,500 25% $2,000 -19% 

Space Station 1.750 2.451 40% 1.900 9% 

Superconducting 

Super Coilider 225 331 47% 243 8% 

Hunvin Genome 60 108 41% 88 47% 

Total 5,635 7,390 31% 5,131 -9% 



SOURCE: MichaeiE. Davey. Congrasslonal Rasearch Servica. "Rasaarch and Oavalopfnant Funding: FY1991 ."iMua 
briaf 690048. t4oy. 13. 1990. 



Tlic vSpace Station promises to require at least $1.5 
billion per year in maintenance—an amount not 
figured into original cost estimates.^^ Much of the 
maintenance support will be transported by the 
Shuttle, which has proven less than reliable in recent 
years. Tliese concerns raise questions about how 
realistically operations are weighed in securing 
approval of megaprojecls. 

Another concern is the **top-down" organization 
of big science projects. For example, one critic of the 
HOP endorses both the goals and the quality of the 
science so far, but calls it . . overtargeted, over- 
budgeted, oveq^rioritized, overadministered, aiid 
. . . micromanaged."^^ In contriust, some projects 
iire criticized for a lack of management: * Though 
over $4 billion has been spent so far on tlie Space 
Station, it exists only as a paper design, iuid with 
virtually no purpti.se beyond serving as a platform for 
the glamour of man in space. Clearly, manage- 
mcnl is an impi)rtjuit consideration in megaproject 
development. 

Any big science project on the forefront of 
experti.se will involve considerable Iciu^ning t)y 



doing. Once a megaproject has been selected, 
real-time evaluations of its progress can also be 
carried out that give rapid feedback to those in- 
volved. While there is no guarantee that agency 
sponsors of megaprojects will listen to evaluators, 
the latter can become another constituency defmed 
into the decisionmaking process. 

In sum, megaprojects will always be selected 
through a political, public process t>ecause of their 
scale, lumpiness, and incommensurability. Yet, for 
each initiative, as the NAS priority report reminds: 
"...it is necessary to specify the institutions, 
individuals, and organizations that will be i[;erved; 
the costs; tlie opportunities for international cooper- 
ation and cost sharing; the management structure; 
and ttie timeliness of the program,"^ The cost of 
investment for the Federal Government and the cost 
per investigator are criteria that apply to all science 
initiatives. The designations **big" and *'littlc" are 
quite variable when projected over time and relative 
to the total value of an agency's portfolio. Clearly, 
tlie process of making Federal research investments 
could become more iterative, less sequential, and 
better oriented to national goiUs. OTA next examines 
an alternative to current practice. 



forties op CI I., tboUiolc "^4. p A2H 

^^Don Drown quoted in Roberts, op. cii . footnote 42» p 7Sfi. Tor example, shcre ,vc now a lolai of six National hwlilules of Htiillh-supponed gctiorrw 
research centers and )?r<)wing (pjL'stions atw»ui acceptable costs aiuJ error rales in s/jqucrnring a gcnonic bcfofc dcj)osil in a (1ataba."?c. See *'Ncnv Huia-SM 
(icnome Centers Eslahlishcd/T/j^'ni/tvi/ A fingmfennfi Nfws, vol 69. No. 6, Feb. 11. 1991, p and UsIicRobcfts. " I afgc-ScaJcSctjucfKi rig Trials 
Uegin," .SVii'/ire. vol 2^0. Dec 7. I WO. pp. I3:V^ I.V^H 

^*"Man in-Sp:ice TJ>c SelMnfhctcd Tursc of NASA." Snenri^ d GtH frnment Report, vol 20. No 1 \ Aug. I, 1990. p. 4 

^*'Sce K (fuy arul I. (ieorghiou. "Real-Time nvaiualioii and !hc Manageincnl of Mission C)ncnlc<l Kcscarch; The Evaluation of Ibe Alvc/ 
Program Aims. Athievcnicnis and If sson.s." unpublishwl paper, presented at Ihc ECF. Sennnar on Evaluation in Ihc Management of R and D, Apr. 
1-7. 1989. In addition, if real-tiiiK evaluation hiid been l>eedcd in the coastniction of the Hubl)le Ifele.scopc. for iiLslincc. a full-fscalc test of the niirroi 
coiiW luivc lieen perfomial. See Bob Davis. "NASA Managcmml Raws Ixd Agency to Ovcflook HuNilc Dcfecl. Panel Find.s.** Wall Utrf ft Journal 
Nov 27. 1990; juid William lifwth, "Hubble Report Faull.s Builder. NASA." TViif Washinf^ton Post, Nov. 28. 1990, p. A8 

''^Nalional Academy of .Scieme.s. op. cii . f(H>rrK)le 17. p 11 
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Research Priorities and the 
Big Picture" 



44 



Figure 5-4 depicts the projected outlays for the 
science base and science megaprojects discussed 
above. The projected expenditures for big science 
project.s rise in the 1990s as an increasingly signifi- 
cant portion of those for science projects as a whole. 
(Since cost estimates for megaprojects tend to grow 
precipitously, a similar figure that doubles those 
expenditures are included for sake of comparison in 
figure 5-4.^^) Within the current funding climate and 
that predicted for the 1990s, perhaps not all compo- 
nents of the current Federal research portfolio can be 
supported. Choices among science projects may 
need to be made. Becau.se of the large projected 
lifetime costs associated with each megaproject, 
soiling and recalibrating the costs of each earlier 
rather than later would be useful. 

How could such choices be made? Ideally, one 
might ask that Federal funds be allocated to tlie 
science base and then add megaprojects in order of 
importance until funds are depleted. Hov/ever, such 
a sequential approach is not realistic. First, there is 
nothing that corresponds to a single reseai ch budget. 
Many countries, for example, Canada, Germany, 
and Sweden, have capital budgets for all functions, 
including research. If the United States had a capital 
budget distinct from its operating budget, then it 
could rate megaprojects against one another and 
compare them with other capital investments. Sec- 
ond, megaprojects are funded on an equal footing in 
many agencies with other research programs. Fi- 
nally, in the words of Albert Tbich, of the American 
Association tor the Advancement of Science: 

Advocates of systematic priority scUing and those 
who may be called on to advise in the prcKcss ncc<l 
to recognize that any such rational analysis is just 
one clement of the picture. Such analysis may 
influence the process, but it does not determine 
priorities. Other factors and other voices will and 
should be heard. Political criteria are not a contami- 
nant in the allocation of public resources for 



research; they are absolutely essential to the demo- 
cratic process and to the long-run effective function- 
ing of the system.^^ 

An annual review of commitments across catego- 
ries of investment would help to gauge balance by 
field, research problem, and agency contributions to 
the achievement of national go^s. By revisiting 
these categories year after year, Federal investments 
could be appraised to add and subtract from the 
Nation's research portfolio.*^ 

Once the context for priority setting is examined, 
tradeoffs and choices take on another dimension. 
What do U.S. society and the Federal Government 
expect for their research investment? What does the 
scientific community promise to deliver? The an- 
swers differ among participants and over time* The 
answers differ because criteria and expectations 
differ, because there are plural research systems, and 
because participants can influence the process of 
budgeting and research decisionmaking at many 
levels. 

Although scientific merit and program relevance 
must always be the first criteria used to judge a 
research program or project's potential worth, they 
cannot be the sole criteria. First, in today *s research 
system, there are many more scientifically meritori- 
ous projects than can be funded. In its initial effort 
to document stress on the Federal research system 
created by an abundance of research applications, 
OTA found that an increasing proportion could not 
be funded by various research agencies due to 
budget limitations, rather than to deficiencies of 
quality.^ Second, rewarding scientific merit and 
relevance alone can inhibit the system from prepar- 
ing for the future. This problem is seen clearly in the 
funding of young investigators. Since the prospec* 
tive yield of new knowledge is judged by the 
technical merit (e.g., soundness of design or experi- 
mental protocol) of a {project proposal, its scientific 
creativity, and the track record of the scientist, 
young investigators are at a disadvantage, and other 
criteria must be weighed when evaluating their 
proposals. 



^^Notc ihAl some cstimiiies of nicgipro)ccts include only capilaJ costi, while other include c«piud and opcrtiling cosli. 

"Albert H. Tfcich, * *ScicaliiiU aiid Public OfficiaU Musi Pwsue CoUaborilion lb Set Research Priorities?/ * The ScienUst, vol. 4. No. 3. Feb. 5. 1990. 
p 17. 

*^To iierite is to plan and exercise flexibility within a budget envelope— much like a National Basketbili Association team ahufOing iu roster to stay 
under (be league*! imposed laJary cap while enjoying a full complement of players at every position 

*<U.S. Congress. Office of Tbchiwlogy Astcssniem. "Proposal F*rcssurc in the 1980s. An Indicator of Stress on the Feacnil Research Syslcm," staff 
paper of the Scteoce. Education, and Transporutiou Program. Apnl 1990. 



ERIC 



17 



Chapter 5-^Priority Setting in Science • 765 



Figure 5-4-^ost Scanarlos for the Science Base and Select MegaprojGcta: Fiscal Years 1990-Z J05 



Current coat estimatea for megaprojecta 



3 percent growth for 
•clence base 
(megaproject funding added on) 



3 percent growth for total 
research funding 
(megaproject funding Included) 



Constant dollara 



Constant dollars 



1990 




2000 



2005 



1990 




2006 



Doubled current cost estimates for megaprojects 



3 percent growth for 
science base 
(megaproject funding added on) 



3 percent growth for total 
research funding 
(megaproject funding Included) 



Constant dollars 



Constant dollara 





1990 1996 
& Science base 



Human genome 



2005 1990 1996 

SSC ^ EOS Space station 



2000 



2005 



KtY: SSC-Sup#rconductfn9 Sup«f Collider: EOS*Earth Ot»»f ving Syitam. 

NOTE: Thaw flgufM ara $ch«fn«tlc r#pr«Mntationd of proj«ct#d ooaU for sdanct projecti. In th« f Iqutm on the l«ft. th« $d9n<» bMSs It proi^ctad to grow 
at «n innual rata of 3 percant abova Inflalton. In tha f igurat on the right, total nMmrch fufxMng It proj^ctad to grow 3 parcant abova *nffatk>n The coat 

vol. 37. No^2. f«P^J2. 1W0 p. A28; and G#n«vl#v« J. Kn#zo, -Sdaoca MagaprojtcU: Status and Funding. Fabruary 1W1." C/?S Raoortfor 
CongrM, 91 -258 SPR (Washington. DC: Congrnttional RMMrc^ Sarvica. Mar 12. 1 W1 ). ^ 
SOURCE: Offic* Tschnotogy Attasamsnt IWI . 
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There is a role for Congress to set priorities across 
and within categories of science and engineering 
research. The application of criteria that augment 
••scientific merit" and ••program relevance' — 
which are today's judgments of quality — would 
clarify tomorrow* s objectives of research invest- 
ment. As discussed in chapter 1, broadly stated, there 
are two such criteria: strengthening education and 
hiunan resources (i.e., increasing the number and 
diversity of participants); and building regional and 
institutional capacity (including economic develop- 
ment by leveraging Federal research support).^ Both 
sets address the future capability of the research 
system in response to national needs, and both can 
be employed in mainstream and set-aside programs. 

Conclusions 

Since progress begets more opportunities for 
research than can be supported, setting research 
priorities may be imperative for the success of 
science in the 1990s.^ And while the questions raised 
in this chapter have a familiar ring — how should 
Federal monies for research be spent? which oppor- 
tunities for scientific advance merit funding now? 
who should decide? — tlie search for a framework to 
judge criteria of cho?ce has grown urgent. In the 
pluralistic and decenU*alized system of research 
decisionmaking, sponsorship, and performance, 
there are ample voices to justify most any hierarchy 
of programs and projects on the grounds of ' •social* * 
or ••scientific" merit. The question of what do U.S. 
society and the Federal Government want for their 
research investments has many answers. 

Long before the onset of stringency in Federal 
discretionary funding, priority setting was an inte- 
gral part of the regular budget process: 

By the time any budget for science has been 
pulled apart by function in the budget conimittees» 
by agency in the legislative committees, and by 
appropriations bills in the appropriations committees 



(in both House and Senate at each of these levels) 
and reassembled among the various other programs 
of veterans' benefits, sewage treatment grants, and 
agricultural price supports, its internal priorities will 
be unrecognizable.^^ 

The problem is not a lack of priority setting. The 
problem is implementing priorities in the name of 
national goals and scientific needs. How can that be 
achieved? 

Some observers of the current priority-setting 
process have suggested improvements to the process 
that are structural, in particular centralizing the 
budget process iuid intensifying research planning 
within and across the agencies. This would make the 
tradeoffs more explicit and less ad hoc, and the 
process more transparent. At a minimum, multiyear 
budgeting and an agency crosscutting budgetary 
analysis (proponents like NAS say) could reduce 
uncertainty in budgeting.^ 

Tb ensure that priorities are set, some persons, 
conmiittees, or bodies of the Federal Government, in 
addition to the President, must be invested with the 
power to set priorities. Agency managers are akeady 
performing this function at a program level, with 
oversight from the legislative branch. At the highest 
level of decisionmaking, however, a crosscutting 
function is required. In the executive branch, OSTP 
and 0MB are the only actors with the ability to play 
such a sweeping role. Without additional legislative 
initiatives, however, OSTP is hampered by the 
powerlessness of its advisory position. And 0MB, 
which has been serving a crosscutting function in the 
executive branch, is not receptive to incorporating 
debate and public decisionmaking on these issues. 
Congress akeady serves, in part, a crosscutting 
priority-setting function. However, Congress has 
o-aditionally been reticent to set priorities. Sugges- 
tions have been made to strengthen Congress' hand 
in research decisionmaking through structural 



•i'Some agency progrwm alrcttly incorporttc these crllcrit. They arc cxpliclUy in usc» for cxtmplc. it the Nttional Science Foundation (NSF) (though 
not in every progmn or dUtciortie) and there have been no cialnu that icientific merit hu been compromiied. At other ageociea, however, these criteria 
arc loen as not a$ important to the research mission (OTA interviews, spring 1990). At the same time, set-aside programs at NSF and elsewhere undcrscofC 
tJic continuing need for ••sbcllercd competitions'* for rcsearcbcn who do not fare wcU in maiosireara disciplinary programs. 

*^Drooks writes: 'Today many of the lame negative signals that existed in 197 1 arc again evident. WUI science recover to experience a new era of 
prosperity as it did beginning in the late seventies, or has the day of reckoning that so many picdicted finally arrived?' * Harvey Brooks. ' 'Can Science 
Survive in the Modem Age? A Revisit After Twenty Years.' * Naiional Forum, vol. 71. No. 4. fall 1990. p. 33. 

^'^Tfclch, op. ci;., footnote 62, p. 18 

«This was, of course, prior to the 1 990 budget summit and passage of the Deficit Con?Jol Act discussed in ch. 3, The Natioiml Academy of Sciences 
discussion is nevertheless instructive. See National Academy of Sciences, op. cit.. footnote 17, pp. 1 M6. especially table 2. Also see U.S. General 
Accounting Office, US, Science and Enf^ineenng Base A Synthrsis of Concerns About Budget atui Policy Developmenu GAO/RCED-87-65 
fWaj4hinglou» DC: March 1987), especially pp. 22-56. 
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change in the budget process^ and there has been an 
evolution toward greater congressional activism. 
However, Congress may wish to strengthen its 
current role as the fmal arbiter of priorities and invest 
others with the discretion to propose priorities. 

Whatever Federal body is designated as having 
the authority of initial choice, its task should extend 
at a minimum to the iterative planning and appraisal 
of accounts that results in: a) limiting the number of 
(or budget commitment entailed by) megaproject 
initiatives, and b) making tradeoffs among research 
fields in the S&T base. For instance, the broad field 
of the life sciences has received substantial increases 
in funding over the last 15 years, while other fields 
have climbed more slowly. Seen as part of the 
Federal research portfolio, the life sciences could be 
stabilized in funding, while certain other fields, 
ranked according to other criteria (e.g., training of 
students), could be slated for augmented funding. 
Already included in most research decisionmaking 
are criteria based first and foremost on scientific 
merit. OTA suggests that two other criteria could be 
added to scientific m.^rit. These criteria emphasize 
planning for the future — strengthening education 
and human resources, and building regional and 
institutional capacity* Education, human resources, 
and regional and institutional capacity are valid 
outcomes of Federal research investments. Progress 



toward achieving national objectives that incoipo- 
' rate these criteria should be monitored with congres- 
sional oversight. 

Reordering the criteria of choice changes the 
process and the expectations of returns from the 
investment in research. Such reconfiguration, per- 
haps seen most clearly in big science projects, 
demonstrates how embedded science and tecimol- 
ogy have become in the myriad needs of the Nation. 
These initiatives are appropriated by political actors 
because they are much more than cutting^ge 
research. They represent **real money* —in jobs, 
industrial development, innovation, trade, and pres- 
tige regionally, nationally, and internationally. This 
is why the constituencies for them are broad and why 
they remain controversial within their respective 
research communities years after having been pro- 
posed and the down payment made by the Federal 
Government. 

Enhanced priority setting could be the 1990s' 
expression of the post- World War II social contract 
that bound science to government. However, greater 
priority setting in science is no panacea for the 
problem of research funding. It is a partial response 
to the problem of how the Federal research system 
can make choices in the coming decade. Another 
response of comparable urgency — understanding 
and coping with research expenditures — ^is dis- 
cussed in chapter 6. 
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CHAPTER 6 

Understanding Research Expenditures 



University r^isearch is a smokestack industry. That the research university's capital 
costs are small and easy to cope with is a myth. 

William F. Massy ^ 

Available data suggest that an increase in the 
number of scientists supported by Federal funds 
combined with real growth in their salaries and 
benefits have figured heavily into total Federal 
expenditures.^ In recent years growth in research 
budgets (i.e., support) has also been accompanied by 
a growth in researcher's expectations (i.e., demand). 
In addition to increased competition through the 
1980s for available agency research funding,^ re- 
search expenditures on scientific projects (both 
direct and indirect) have grown, generally above the 
rate of inflation. Some claim that research requires 
more expenditures today because of complexity: 
what was done yesterday can often be done cheaper 
today, but ' 'tomorrow's science'* may cost more. As 
understanding of natural and social phenomena 
increases, the questions to be answered become 
more intricate, resulting in increased expenditures or 
* 'sophistication inflation.''^ Complying with in- 
creasing layers of regulation has also been cited as 
responsible for increased expenditures.^ 

Unfortunately, few systematic analyses have been 
performed to evaluate these claims. Complicating 
questions on the cost of research are incomplete and 
murky data or research expenditures. Definitions of 
what is being measured over time are straightfor- 
wiird» but the activity that they purport to capture is 
constantly changing. In addition, much of Uie 
ciureni debate over expenditures takes place within 



'William F. Massy. "Cup iml Invesuncm »or Ihc Fumre of niomedical Kesctuch. A Uiuvcrsiiy Ckucf Fumncial Officer's Wicw/ ' Acacienuc MediciM, 
vol. 64. August 1989. p. 43 V 

^Rcscarcbcrs arc now subiniUint; more proposals lo improve Ihcir cliaiiccs of fnainlaiiiing or mcfoaiiiig previo us supp')rt I' c\s National Sciccicc 
Fomulalion. "NSF Vital Sigii.s: Ircnds m Research Support FY HO H9." druft report. November. 1990. p :^ Ttic Waoonftl Science Foundation (NSn 
found thai the average ninubcr of proposals subfT^iticd hy aii investigator to win one NSF award liad risen from about 1 .5 to 1 .7. NSF notes ilut these 
data do not address the c;^teiil to which ihc increase m proposal suhinission.s to NSF is ihciesult of perceived difficulty iit winning awards or other factors 
such as growth in the population oi fcseiirch fields or greater pressure to wui awards for ptofessioiul .idvmicctncnt. 

M' S rongft*«. Oflkcof lixhnology Assessment. "Propos M Pressure in the \Wh An Indiaitor of Stress on liie I'ederal Research System." staff 
paper ot the Science. lUhicalion. and TransportaticiO J^ogiam. April 1990 

*Sat'm V The Endnfthv f t.intier'^ i\ report from I /^on M lijdcmiaii. pff sidcnt cicct. to tiK: Dnard t)f DirccJors of the American A.ssociation for the 
Advancement of .Scicme (Washington. DC American Association for the Adsan.cnicni of Scietwe. iunuiuy l'/>l). p ^\ and D Allan Bromley. 
''Kty\M\i \Mn'^^:^ Science andTechuylo^y and the ChiVi^^ VV;;/7iyOr(/£T ti)lloquium priKccdings. Apr. 12- 199(».S.O Saner (ed.) (Wastung ton. 
IX' Amencitn AsscKiation for tlie Advancement of Science. 199(^« p ! 1 

^Nalion^** Scieuve FoufHldHon. Saentifu ik»id f njitneenmi Hesean h FaKtlinfs at (fniversuifs and CoUexr^ ^vVfJ (Washington. \yC September 
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Introduction 

Many researchers state that the problem with 
research funding in the United States is that it has not 
kept pace with inflation. * 'Inflation' ' in this context 
refers not to inflation in the Gross National Product, 
but to the rise in apparent research costs. Several 
factors contribute to research expenditures, but the 
most notable is the sheer size of the enterprise. 

Contributing to confusion over the issue of costs 
in research are the numerous and sometimes incon- 
sistent meanings of "costs," and the lack of a 
suitable measure of "research.'* Specific research 
activities generally become cheaper to complete 
with time, due to increasing productivity, for exam- 
ple, of computers and other technologies. However, 
advances in technology and knowledge also allow 
deeper probing of more complex scientific problems 
and create demiuid for greater resources. Because 
success in the research environment depends heavily 
on "getting there first/' there is clem advantage to 
having the financial support to acquire additional 
staff and cutling-edge technology. Thus, comixjli- 
tion drives up deiniuid for fundutg. In this senstN the 
demand for more resources (costs of research) will 
continue to outpace any increases in Federal fiuid- 
ing. (For a more complete discussion, see chapter 1 .) 
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the context of agency budget constraints and pres- 
sures felt by research performers. Determining what 
is an adequate amount of Federal money for the 
conduct of research is not easy, and is only 
compounded by confusion over true costs.^ 

Analysis of expenditures for the conduct of 
research focuses on what Federal agencies are 
willing to spend for personnel, facilities, and instru- 
mentation, but gives neither an accurate picture of 
what the needs are nor whether expenditures are 
being totally recovered by the research performers 7 
Individual components of the research budget have 
not risen significantly, with the exception of salaries 
and fringe benefits. However, more scientists and 
engineers are doing research; they are getting paid 
more for their work, and they are spending more. 
Annual expenditures, including operating, equip- 
ment, and capital (facilities) spending per full- time 
equivalent investigator, are estimated to have in- 
creased irom $85,000 (1988 dollars) in 1958 to 
about $170,000 by the late 1960s, where they 
leveled off through the 1 970s. In the 1980s, expendi- 
tures rose to $225,000 (see figure 6-1). 

Thus, an academic scientist today spends almost 
three times as much (in real terms) for research as in 
1958. Figure 6-2 shows that expenditures have risen 
in every component (personnel, facilities, equip- 
ment, students, other) for three decades. However, 
available data point to personnel and indirect cost 
expenditures as the most important components of 
increases. Personnel expenditures have less account- 
ing flexibility: unlike facilities and instrumentation 
costs, they cannot be deferred or depreciated.^ 
Federally supported academic research is sa.).ary 
intensive. This leads to salaries and fringe benefits 



affecting the direct cost equation more than nonper- 
sonnel items* 

Indirect costs have been rising faster than direct 
costs. Academic institutions claim that is because 
t^^e more expensive items, such as facilities and 
auministration, more often fall into the indirect cost 
category, while controllable expenditures, such as 
research personnel and graduate students, fall into 
the direct cost line. The confusion about indirect v. 
direct costs of research is, in part, complicated by 
philosophical differences about where expenditures 
should be assigned. For at least the past 20 years, a 
debate has been carried on between university 
administrators and Federal granting agencies over 
who should pay for what in academic-based re- 
search. Although the grant is for research, it is signed 
with an institution, which incurs expenditures be- 
yond the scope of the research being performed. It 
has been the practice of the Federal Government to 
consider research as integral to the university 
mission and, therefore, its cost should be shared by 
both parties.^ 

This chapter looks at the issue of research 
expenditures from two perspectives — the Federal 
Government as funder» and the research university as 
performer. Available data concerning specific 
budget items (e.g., salaries, instiiunentationt indirect 
costs, and facilities) are presented. These data are 
collected by granting agencies and tend to reflect 
agency expenditures rather than actual costs to the 
researcher. Expenditures, as recognized from the 
perspective of the university research performer, are 
also discussed as a component of financial planning, 
proposal-writing strategies, and changing expecta- 
tions. 



^For 411 illiLSlralion, sec Daniel E. Koshland. ' "Hk: t Jntlcrsidc of Overhead. ' * Scitni f. vol . 2^ 8, May 1 1 , 1990, p. 645; and Icltcrs. published as ' *Thc 
Overl^ctfd Question.' in response to Koshiand's ediiortal, Science, vol. 249, July 6. 19^. pp. 10-11 

'Analysis is confounded by ihe expenditure accounting schemes that vary from research institution to institution, making comparisons both difTicull 
and perilous. For an attempt to compare expenditures at two public and (wo private universities associated with tlic performance of National Scitrce 
Foundation-funded research, seeG.W. Baughman, ''Impact of Inflation on Research Expenditures of Selected Academic Disciplines 1967*1983," report 
prepared for the Nndooal Science Foundadon lu^. th^ NMioaai ('enter for Educational Sutistics. Nov. 8. 1985. Also see Research Associateis of 
Washington, Higher Education Price Indexes: 1990 Update Washington, DC: 1990). 

*For at least the fifth consecutive year, faculty salaries have inc'cased more thaii the cost of living. From Novemb<^r 1989 to Novciube}' 1990, the 
consumer price index increased 6.3 percent. During that same period, avert^v faculty pay increased 7.1 percent. Reported in "Faculty Fay and the Cost 
of Living." cliart. The Chronicle of Higher Education, vol. 37. No. 17. Jan. f. 1991, p. A15. 

"^is practice fuels what Is known as the ' 'full cost recovery' * debate. See Stephen P. Strickland. Resew h and the HeaUh o/Amencans (Ixxington. 
MA: Lexington Books. 1978). 

'^,xpenditures in indusin^l research arc not considered here, bu! have been addressed m two other OTA rf^Jorts. See U.S. Congress. Ohicc of 
Tbchnology Assessment. Making} Things Better Competing in Manufacturing, OTA-ITE-443 (Washington. I>C: U.S. Oovemmcni Printing Office. 
February 1990); and Government Policies 4 Pharmaceutical Research and Development (Washington. DC: U.S. Government Printing Office, 
forthcoming 1991). 
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Figure 6-1--Academlc R&D Expenditures per FTE 
Investigator by lype of Expenditure: 1958-88 
(In thouMnds of 1988 dollari) 



1988 dollars (In thoussnds) 




1958 1963 1988 1973 1978 1983 1988 



Opsratino funds Equipment 
R&D facilities 

NOTE: Constant doHars wara calculatad using tha GNP Implldt Prlca 
Daflator. 

OEFINmON OF TERMS: Oparating funds rafar to currant fund axp«ndi* 
tursa for aeadamio rasMroh and davalopmant (R&D) actlvitiaa that 
•rssaparataly budgatsdarxJ aooountad for, including axpsndit uras 
forsaniorsciantlstandgraduataatudantoompanaation.othsrdlract 
ooits, and indlrad costs aisodatsd wtth conduct of acadamlo 
rtssarch. Equ^pmant Indudas raporlad axpandituras of saparataly 
budg«tad currsnt funda fof tha purchasa of ■cadamio rasaarch 
aqulpmant, tnd satlmatsd capital axpandituras for fixad or built-in 
rasaarch squlpmant. R&D fadiltlaa Induda astimatsd capital ax- 
pandituras for acadamic rasaardi facilitlas. FuH-tlma aquivat^nt 
(RE) in vsstlgators Induda t hosa adantists and anglncf conduct- 
ing fundad rsaparataiy budgatad) acadamio R&D; th« RE is an 
•stimata, da... 'ad Uom tha fraction of faculty tins spant \v mosa 
rasaarch activitiss, ncnfaouity adantists and anginasrs ampioysc 
to conduct ra&sardi In campus fadlitiss (axcapt ftflaraily fundad 
RAD cantsra). and postdoctoral raaaarchars worthing In acadamic 
institutions. 

SOURCE: Govarnmant-UnivsrsIty-lndustry Rasaarch Roundtabla. Sd- 
anca and Technology in the Acitd^mk: Ent^fpris*: Status, 
Trondt andlsBu^ (Washington, DC: National Ac^amy Prass. 

1969). figure 2^5. 



Figure 6-2— Estimated Cost Components of 
U.S. Academic R&D Budgets: 1958-88 
(in billions of 1988 dollars) 

1988 dollars (in billions) 




1958 1963 1968 1973 1978 1983 1988 



Senior Graduate Other direct 

scierNats students 

-e- IndirdCt Equipment -K- Facilities 

NOTE: Constant dollars wara calculatad using tha QNP Implidt Price 
Daflator. 
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lea. and student services administration. Equipment costi^ induda 
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tures forfixedorbuKt-in raaciarv-h equipment. Kadlitlea coctsindudu 
astknatad capital axpandituras for research facilities, induding 
fadlittae constnicted to housa sciantlfic appttrati». 

DATA: National Sdence Foundation. Division of Policy Rasearch and 
Analysis. Dotabwa: CASPAR. Some of the data within \his 
database era estimates. Incorporated where thara era discontinui- 
ties within data sartas or gaps in data collection. Primary dr^ta 
sourca: National Sdsnce Foundation, Division of Sdance Ra- 
sources Stud las. Survey of Sdentif ic and Englnearing Expandltur^s 
atUnivarsltiasandCoi!egas;Nationali/tatitutesolHeaith;Amafican 
Assodatlon of University Profassors; National Assodaiion of Stata 
Univarsitias and Land^rant Collegss. 

SOURCE: Govarnmant-Unlvarsity-industry Raseardi Roundtabia, 5c/- 
anoa and Technology in tha Acadamic Entarpriaa: Status, 
Trands and Issues (Washington, D^ National Ac&damy Prass. 
19d9)Jigura 2-43. 
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Photo or0jft: R^s^mch Trianglo InattuW 



The- cost of complying ivith regulations of research 
procedures and equipment Is one of a long list of changing 
ex;i>enditure8 for Federal research. However, Indirect costs 
and salaries are the largest expenditures In federally 
funded resaarch. 

Expenditures From the Federal 
Perspective 

This section explores what is known about 
research expenditures from the perspectives and 
dalabuses of two granting agencies — the National 
Science Foundation (NSF) and the National Insti- 
tutes of Health (NIH). It also includes a discussion 
of cost data collected by NSF pertaining to all 
Federal research and development (R&D) (as that is 
the level at which the available data are aggregated), 
a.s wcU as analyses conducted by the National 
Academy of Sciences and other cost analysts. 

Direct v. Indirect Costs 

The Office of Management and Budget (0MB) 
guidelines for indirect costs include those that are 



incurred for common or joint objectives and there* 
fore cannot be identified readily and specifically 
with a particular sponsored project, an instruction^ 
program, or any other institutional activity,'^ Indi- 
rect costs reflect the contractual arrangements be- 
tween the agency and a particular university, regard- 
less of actual expendimres at that university. The 
rate is negotiated based on allowable charges, past 
experiences, and expectations for the period under 
negotiation. The indirect cost ratio is the proportion 
of total award budget applied to indirect costs. In 
general, all research agencies pay the same indirect 
cost rate at a given institution (the Department of 
Agriculture is the exception in that formulas are 
used). Direct costs are diose that can be identified 
witli a particular sponsored project, instructional 
program, or any other institutional activity; or that 
can be directly assigned to such activities with a high 
degree of accuracy. 

The guidelines for calculating costs were devel- 
oped in conjunction with 0MB Circular A-21 and 
have been in force since 1979. 0MB also specifies 
the method for calculating the indirect portion of 
salaries and wages paid to professional employees. 
A requirement exists for assigned workload to be 
incorporated into the official records and for that 
system to reflect 100 percent of the work for which 
the employee is being compensated.^^ Thus, the 
record should show the percentage of time spent on 
research, teaching, and administrative duties. 

Every major research university has an indirect 
rate established for the current fiscal year for 
recovery of costs associated with sponsored re- 
search. These rates have evolved over many years as 
a result of direct interaction and negotiation with the 
cognizant Federal agency. There is a wide range of 
indirect cost rates among universities, with most 
noticeable differences between public and private 
institutions; rates tend to be higher at private 
institutions.^^ Rates vary because of: 1) real and 
significant differences in facilities-related expendi- 
tures, 2) tacit or overt underrecovcry by some 
universities, 3) imposition of arbitrary limits by 



•>U.S.DcpartnicraofConin>crcc»Bure«u of Economic Analysis, Biomedical Rescarchand Development Price Iruiex: Report it) /he National Institutes 
of Health (Washinfi.lon. DC: Mar. 30, 1990). 

^^Ibiil, p. 1 8. \iHQ sec U.S . Congress, Office of Tbchnology Assessment. The Regulatory Environment for Science. OTA-TM-SE'l' 34 (Springfield, 
VA: Naiioiml Tfcchnical Information Service. February 1986), pp. 73-76. 

^'Rcp. John Dingeirs Energy an<l Commerce Subcommiltee on Ovcrsighl and Invesiigalions lauiKbed in laie fall 1990 an invcsligaUon of mdirccl 
cost praciicci} al universities, bcginiung wilh Stanford. See Marcia Barinaga. ''Sunford Sails Inio a Siorm/* Science, vol. 250, Dec. 21, 1990, p. 165 1 ; 
• Govcrt.mcJii Inquiry/* Stanford Observer, November- December 1990, pp. 1. 1 3; and Marcia Barinaga, **Indirecl Cosls. How Does Suuiford Compoie 
With Us Pccn^;* Sc.nce, vol. 251, Feb. 15, 1991. pp. 734-''35. 
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Figure 6-3— indlract Cost Ratios for NSF and NIH: 
1966*88 (indlract cost as a percent of total R&D cost) 

In percent 
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Indirect cost rates vary In part because of differences In 
campus facilities. TTie University of Michigan, pictured 
here, devotes many of Its facilities to research. 

trative and student service components reflects the 
difficulty of separating expenditures along lines of 
research, instruction, and other functions.^^ Equip- 
ment and facilities-related components of the rate 
seem to be less controversial, perhaps because of 
better documentation of expenses in these areas. 
Some have advocated that two rates should be 
calculated for indirect costs— one for facilities and 
equipment, and one for all other components, such 
as administrative, library, and student services, 
This view has considerable relevance as universities 
renovate or replace aging facilities and equipment. 

Aggregate Expenditure Data for Personnel, 
Facilities; and Equipment 

Expenditures for facilities and equipment are 
frequently cited as a drain on the academic financial 
resource base. These data, however, mix actual and 
planned expenditures. As universities compete 
against industry and each other for resources, 
funding needs grow* as does spending. Competition 
in the university environment has also driven up the 
**set up" price of the average scientist. Data on 
salaries and personnel are more reliable because 

AssocUlion of American Universi lies. Indirect Costs Associated With federal Support of Research on University Campuses • Some Suggestions for 
Chanfit (Washington, DC: December 1988). 

*'^Eleai»rC. Thomaa aod Leonard L. Ledcrman, Directorate for Scirntific. Tbchnological. and Intcnuitional Affairs, Nalional Science Foundation, 
'•Indirect Costs of Federally Funded Academic Research," linpublishcd report. Aug. 3, 1984, p. 1. 

**As$octiiioa of American Unjvenitics, op. cil., foomoie 14. 

*''rhc Goveromcnt'Univcr*ily-Industry Research RoundUblc, Science and Technology in the Academic Enterprise: Status, Trends, and Issues 
(Washington, DC: National Academy Prcsji, 1989). p. 2-33. 



KEY: NIH-Nationai Institutas of Health; NSF-tNational Sd0nc« Founda- 
tion. 

SOURCE: National Science Foundation, PoUcy Research and Analysis 
Division, estimates baaed on unpublished NIH and NSF data. 
1990. 

some goveiiiiiicnt agencies in the negotiation pro- 
cess, and 4) diversity in assigning component 
expenditures as direct or indirect.^'* 

Figure 6-3 indicates the trends in indirect costs ius 
a proportion of total research ex|)enditures for NIH 
and NSF. In part, the ratios vary because NIH 
separates direct and indirect costs, and proposals are 
evaluated based mainly on direct costs. NSF, on the 
other hand, considers total costs in making an award 
(usually after merit review). 

Confusion about the relationship between the 
indirect cost rate and what is allowable for adinin^s- 
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these cost categories cannot be deferred and are 
documented annually. 

Personnel 

For the past three decades, personnel expenditures 
have accounted for about 45 percent of total costs of 
academic research charged to the Federal Govern- 
ment, consistently the largest share of the budget. 
Salaries have been on the rise and from 1981 to 1988 
the number of scientists and engineers employed in 
academic settings increased steadily from about 
275,000 to ahnost 340,000.^^ Increased numbers of 
investigators and rising salaries (and the benefits 
that go with them) have driven up the price of the 
personnel component of direct costs. In ^ture years, 
it is anticipated that the personnel component of 
research budgets will rise further due to a faster rate 
of inflation in salaries than in other categories such 
as equipment and facilities.^' And the fiscal year 
1991 appropriation for NSF lifted the $95,000 
annual salary cap on principal investigators that can 
be charged to a grant.^ 

The patterns for spending on graduate students 
mirror that for principal investigators. Increases in 
the number of graduate students supported, how* 
ever, were larger than the growth in the number of 
scientists due to a greater rehance on the research 
grant as a support mechanism.^^ 

Research Facilities Construction and 
Renovation 

Research facilities may be defmed as the environ- 
ment within which research is conducted, as op- 
posed to research instruments, or the tools that 
scientists and engineers use to collect data. Facilities 
cunently receive about 10 percent of the Fedenil 



R&D budget compared to about 6 percent at the 
beginning of the 1980s.^^ Most of the data available 
on scientific and engineering research facilities are 
collected by NSF on a biennial basis in response to 
the 1986 National Science Foundation Authoriza- 
tion Act (Public Law 99-159). The act required NSF 
to design, establish, and maintain a data collection 
and analysis capability for the purpose of identifying 
and assessing the research facilities needs of univer-* 
sities and colleges. Data are not available before 
1986. The assessments are based in part on esti- 
mates, relying on reported capital projects — both 
actual and planned — and anticipated spending for 
construction and repairs of research facilities.^^ 
Actual expenditure data are derived from expendi* 
tures in previous years. 

In constant 1988 dollars, annual capital expendi- 
tures for academic science and engineering facilities 
nearly tripled during the ''golden age*' from $1.3 
billion in 1958 to $3.5 billion a decade later. 
Expenditures dropped to $1 billion in 1979 (1988 
dollars) and stand at $2 billion in 1988. Presently, 
the Federal share of facilities funding is 11 percent, 
down from a high of 32 percent in the 1960s.^ 

In 1986-87, academic institutions initiated major 
repair and renovation projects in academic research 
space totaling $840 million. In 1988-89, this figiu-e 
rose to $1.04 billion.^ Estimated deferral rates for 
repair and renovation are $4.25 for every dollar spent 
in 1990, up from $3.60 in 1988.^^ 

Institutions' spending for new construction of 
research facilities was expected to grow from $2.0 
billion in 1986-87 to $3.4 billion in 1988-89, an 
average increase of about 30 percent per year.^^ A 
1990 update revealed that costs for 1988-89 new 



I'Ibid.. p. 2-34. btaed on Natiooal Science Foundation dan. 

^^ational Science Foundation, The State of Academic Science and Engineering CWashingtoo, DC: 1990), pp. 119-149. Of course, penonnel 
expendintres would be much higher if full salary and fringe beneflls were charged to tlie Federal Qovermncnt. Most universities absorb a substantial 
poition of such expenditures. Some agency programs will pay for only 2 to 3 summer months. Leonard Lederman, Dir^torate for Scientific. 
Ibchoological, and International Affairs, National Science Foundation, personaJ communication, December 1990. 

»*'NSF Back lb Normal After Budget PauK,' ' Chemical A Engineering News, vol. 68, No. 4«. Nov. 26, 1990, p. 12. 

^^Naiional Science Foundation, op. cit., foomobe 19. pp. 124-125. 

»:bid..pp.l34-139. 

^According to National Science Foundation conmicntators on this Oclober 1 990 OTA draft c^uiptcr. estimates of ' •need" denote deferral of facilities 
expenditure.1 (both new conj^tructiou and repair/renovation projccU), not an imtitutionaJ ''wish list." National Science Foundation staff, pcreonal 
communication, Decemba 1990. 

^Oovcmment-University-Jnduxiry Resciirch Roundtable, op. cit.» footnote 17, pp. 2-28, 2-29. 

^National Science Foundation, op. ciL. foomole 5, p. xvii. 

^Ibid., p. xix. 

^National Science Fou" Sciennfic and Engineering Research facilints at Universities and Collegen I9H8 {Washington. DC: September 
1988). 
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FIguro a4-*Total Exoenditures and Unit Costs for Recent and Planned Academic 

Capital Projects: 1986-91 
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SOURCE: Nallonal Sdtoca Foundation, Sckntific Mnd Engh^ming Rasaarc/i FacTtf/tfaj a/ UnlvniH^B andCoH^^: 
1990, final raporl. NSF 90-316 (Washington. DC: 1990), chart 4. and p. A-10. 



construction projects totaled only $2.5 billion, 
consid.rably less than projected.^ Private institu- 
tions among the top SO recipients of Federal R&D 
funds report considerably higher spending levels 
than public institutions, both for construction and 
repair and renovation. The reverse is true among 
institutions not in the top 50, v/here spending levels 
are higher at public institutions.^^ 

The unit cost of new construction (the cost per net 
square foot) grew in real terms from $207 in 1986-87 
to $23 1 in 1988-89, an increase of about 12 percent 
per year (see figure 6-4). ConsUuction expenditure 
increases of this magnitude, which are above the rate 
of inflation, are attributed in part to changing 
technical and regulatory requirements such as ani- 



mal quarters,^^ biohazard containment safeguards, 
and toxic waste disposal facilities. These regulatory 
requirements are especially relevant to the medical 
and biological sciences, but vary with the institu- 
tional setting in which the research is conducted.^^ 

The proportion of Federal support for construc- 
tion is about 1 1 percent in private institutions and 8 
percent in public institutions (sec figure 6-5). The 
Federal Government also pays for renovation and 
repair costs in part through the indirect cost rate, and 
in 1988, the Federal Government supplied nearly $1 
billion to support university infrasmicture through 
indirect costs. Almost 20 percent was for facilities 
depreciation, while the rest was recovered for 



^^Natloruii Science Poundation, op. cit.. footnote 5 Thz report suggest that inability to obuun sufficient funding was U)c piiucipHl reason given by 
Ui5iitutions for postpouing or scaling bttck planned con^miction projecti. 
2^lbid.. pp. 19-24. 

5<>Thc Alcohol. Drug Abuse, and Mental HealUi Admiiiistraiion estimates that new rtgnJalions for animal care will cosi $40,000 to $70,000 per grant 
for the care of primates ind dogi. See Constance Holdcn. *'A Preemptive Strike for Animal Rciearcli,** Science, vol. 244. Apr. 28, 1989, pp. 415-416. 
An American Association of Medical Colleges survey of 126 medical schools estimated that animal rights acUvitics cost U.S. mcdkaJ schools 
approximately 1 17.6 million for iccrcaseil security, insurance, recordkeeping, a^d compliance over the last 5 years; as reported in Washington Fax, July 
23. 1990. 

^^Officc of TechooloKy Assessmcoi, op. cit.. fcK u\ob^ 12. i^p. 83-96. Also see Philip H. AUlson. ^'Federal Iwipedimcnls to Scientific Research/* 
Science, vol. 2ru» } cb H J 991. p. 605 Abclson esuairuc* thai the Federal Oovemment imposed more ih-^n 23 administrative reporting rKittlrcmcnis 
on universities dunng lii-^ 1980s. 
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Figure 6*5--Relatlve Sources of Funds for Research Facilities: Academic Capital 

Prolects Begun in 1986-89 
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SOURCE: National Sdenca Foundation. Scientific and Engineering Research FscHliles at Universities and Colleges: 
1990, final raport, NSF 90-316 (Washlnglon, DC: 1990), chart 6. 



Inatituttonal funds 
r I Debt financing 
I 1 Other sources 



operation and maintenance costs. In absolute 
terms, Federal funds for new construction of re- 
search space more than doubled over the 1986 to 
1989 period, aiid the increase was seen primarily at 
public institutions. 

Equipment and Instrumentation 

There is one comprehensive source of data on 
research equipment and instrumentation expendi- 
tures. The National Survey of Academic Research 
Instruments and Instrumentation Needs is a congres- 
sionally mandated, triennial survey program to 
monitor trends in academic research. It is sponsored 
jointly by NIH and NSF, iind has been completed 
twice, first in 1983-84 and again in 1986^87.^^ A 
new survey is in progress. The survey collects data 
about expenditures, funding, and use of major 



research instnnnents (costing $10,000 to $1 million) 
in engineering, and in the agricultural, biological, 
computer, environmental, and physical sciences. 
Information is collected about both quantitative and 
qualitative changes in in-use instrumentation and 
e<|uipment. 

Results from these surveys show that there is 
substantial turnover in the national stock of in-use 
academic research equipment. About one out of 
every four systems in research use in 1982-83 was no 
longer being used for research by 1985-86, and about 
two out of five systems in research use in 1985-86 
had been acquired in the 3-year period since the 
baseline data were obtained. Computer science had 
the most rapid rate of expansion in stock (up 138 
percent over tlie 1982 to 1986 period), with slow 



mm have coninbulcd greatly to (tic rising indirect cost rciinbursenwnis Over the p<;rio<t 1982 to 1988. itie Federal support of unlvcisiry 
cmre (hmugli irKiireci ^osl recovery grew by over 70 percent in real tcnD.s Sec ^^Enhancing Research and ExpaiuUng ttw Human I-mnlicr " 



irifras tincture ^. ©.w.^ .y, m ivai icnu.^ 3cc i^iujouciut; t^cscanrn aim uxpaiHung uie Muman iToniicr " 

Budnetofthf United States Government. n.tcai Year 1992 (Washington. DC: US (jovenuncnt Mnting Office. 1991). pp This documcnl further 

stales that; "Each academic iatlitutton must provide a certification tliat its research facilities arc adequate (to perform (he research proposed) as a 
coiKlition of accepting research grants. (TIjcI $12 bUlion of needed, but unfunded capital projects has not had an apparent effect on ihc ability of 
wuvcrsitics to accept Federal research funds/^ The $12 billion esiiiniitc conkjs from tlic 1990 Natiomil Science Foundation survey of universities. 

"National SciciKrc Foundation, AcaiiemU' Research Equipment in Selected Science! Ensineennji Fields J 982-83 to 1985-86 SRS gR-Dl 
(Washmgton, DC: iuiic 1988). .o . ooi^i 

^Ibid 
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Photo endh: Jiy Mangum Photography 

Researcher uses a CT scanner. State-of-the-art 
equipment often enables researchers to push the frontiers 
of scientific Knowledge. 

growth in mechanical engineering (up 23 percent) 
and materials science (22 percent). The data indicate 
that Federal and non-Federal expenditures for aca- 
demic research equipment increased from $393 
million (1982 dollars) in 1980 to $704 million in 
1987.35 Yet the mean purchase price per system for 
all in-use equipment in 1985-86 was $36,800, 
basically unchanged from 1982-83 (up only 1 
percent after inflation). Computer science was tlie 
only field to show a substantial real change in the 
mean price per unit of in-use instrumentation, 
dropping 22 percent after adjusting for inflation.^^^ 

Federal involvement in funding academic re- 
search equipment declined somewhat from 1982-83 
to 1985-86. Fifty -five percent of all .systems in use 
in 1986 were acquired eitlier partly or entirely witli 
Federal funding support, down from 60 percent in 
1982-83. Despite this relative decline. Federal 
support for in-use research equipment increased 30 
percent in real dollar tenus, from $663 million in 
1982-83 to $906 niiUion in 1985-86." Data for 



select Federal funding sources are displayed in table 
6-1. Not unexpectedly, funding for equipment under 
development, or considered state-of-the-art, grew at 
higher rates than existing systems. Qualitative 
upgrading (e.g., incremental improvement in the 
power and capability of existing equipment), how- 
ever, varies across fields, e.g„ chemistry experi- 
enced more upgrading than agricultural sciences. 

Despite pronounced increases and improvements 
in equipment stocks in *e 1980s, 36 percent of 
department heads still describe their equipment as 
inadequate (to conduct state-of-the-art research). In 
general, the survey data reveal that equipment stocks 
have been substantially replenished and refurbished 
during the period of 1982 to 1986 in all of the fields 
studied and in all types of institutions. There have 
been substantially increased levels of support for 
instrumentation from all sources, with most of this 
increased support coming from the colleges and 
universities themselves, as well as from businesses, 
private donors, and State governments. In relative 
terms, computer science was the greatest beneficiary 
of the overall increase in instrumentation support, 
particularly from Federal sources, witli engineering 
suffering the most. Among all Federal sources of 
equipment support, NSF provided the largest shaie 
(33 percent of the total). 

Within the biological scienceii, biochcmisUy 
more than doubled its equipment stocks between 
1984 and 1987, the fastest rate of growth of any 
major biological field. There appears to be an 
increasing need in the biological sciences for big- 
ticket items costing over $50,000 (1984 and 1987 
prices for some items are shown in table 6-2). The 
percentage of department heads reporting equipment 
in this range as being their top priority for more 
Federal funding increased from 20 percent to 35 
percent from 1984 to 1987.3' 

Expenditures for equipment were $200 million 
(1988 dollars) in 1958, rose to $600 million in the 
1960s, fell to below $400 million in the 1970s, and 



"Ibid , p. 17. 

universities, however. spciKl more on equipment iJum oUwrs Tl.e lop 20 research and developineni universities had in stock m «ver.wc of 

i!^^z!i;':r:oS^ no-'flf'' ""'""^ '^^''^'"^ ^-^-^ '^^^ 

^'National ScieiKX FouiuJttlion. op. cii, foomofc .13. p 17 

„. °/ ""''^ ""™«" Services, National lasliiutes of Health. AcaJemtc Research tmupmeni and Euuipment Needs in the 

BwloKual Sciences l9H4.m7 (WasUingior.. DC: June 1989). pp. 8-1 airough 8-10. i^uipmeni NeeM m the 
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Table 6-1— Selected Sources of Funding for 1985-86 National Stock of In-use Research Equipment and 
Percent Change From 1982-83,* by Field (in mtllions of 1985-86 dollars) 

iibtai state/ 

research university Business 

Reld equipment NSF NIH P OD DOE funds donations 

Computer science $100(85%) $26(123%) $1 (UE) $20"(99%) <$1 (UE) $25(38%) $20(61%) 

Enalnearlna- 372(34%) 38(1%) 5 (UE) 59(16%) 17(15%) 135(35%) 81(47%) 

^iSS 110 59% 11 4% 1 UE 23 11%) 2 (UE) 30(142%) 36(187%) 

MSiai"";:;;:;;::::::::::: 7?S 7 -1?/,) <i ue 16(23%) kue) 28(66%) 13(52%) 

other 191(23%) 20(5%) 5 (UE) 20(18%) 14(45%) 78(10%) 32(43%) 

Materials science 44(26%) 19(33%) <1 (UE) 3(UE) 4 (UE) 11(23%) 2 (UE) 

Physlcsyastronomy 221(16%) 54(1%) 1 (UE) 28(13%) 29(0%) 50 (88%) 14(2%) 

Chemistry 322(44%) 85(22%) 32 (64%) .15(54%) 17 (186%) 1 11 (38%) 28(78%) 

Environmental sciences 170(47%) 30(71o/,) i (ue) 10(44%) 15(70%) 56(50%) 27(39%) 

Agricultural sciences 62(61%) 4 (UE) 2 (UE) <1 (UE) 1 (UE) 39(55%) 6 (UE) 

Biological sciences: 643(48%) 51(39%) 226 (44%) 7(UE) 4 (UE) 247 (54%) 48(53%) 

InSges/unlversI^^^^ 283 63% 32 (26%) 79(51%) 5 (UE) 2 (UE) 123 (89% 19 45% 

In medical schoo ls 360(389%) 19(66%) 148(41%) 2(UE) 2 (UE) 124(31%) 29(59%) 

■Perc«nt Chang* MlimolM art adjusted lof Inllalton. ^ . , r. . „„r. n e n^>.,i.. • c.rm.. 

KEY: NSF - National Sctanca Foundation; NIH - Natlonal Institulas ol Health; DOD - U.S. Department of Defense; DOE - U.S. Department of Energy. 

UE - unstable estimate: 1982-S3 base Is less than $4 million. 
SOURCE: National Science Foundation, Academic Rastarch Equipment In S«l»ct»<iSci»nat/EnQin— ring FMds: 19B2-83to rSflS-afi (Washington. DC: June 
1988), table A. 

Table b'-2— Types and Expenditures for Most Needed Research Equipment: 
National Estimates for the Biological Sciences, 1984 and 1987* 

Per cent of requests Median cost pe r system 
Types of system ~1?84~ 1987 1984 1987 

Preparative (e.g., centrifuges. 

scintillation counters. lncuk)ator8)... 33% 25% $30,000 $35,000 

ProtelfVDNA sequencers/ ^ 

synthesizers 11 14 75.000 95.000 

Electron microscopy 12 6 150.000 180.000 

Light microscopy 4 3 30.000 35.000 

High-pressure liquid chronr^atography . 9 12 27,000 25,000 

Cell sorters/counters 4 6 150.000 100.000 

MNR spectroscopy 4 4 250.000 225.000 

General spectroscopy 9 5 25.000 30,000 

Mass spectroscopy 2 4 125.000 100.000 

imagfl analyzers 3 6 40.000 100,000 

X-ray (other than imaging) 1 1 100.000 200,000 

Computers 5 5 50.000 45,000 

Other 6 9 30.000 45.000 

ARndlngs are based on department chairs' listings ot up to three 'lopmost priorities" In research Instruments or 
systems. 

SOURCE; National Institutes of Health, Academic Rtstarch EqulpimnI and Equlpimnt N0wi$ In th» Biological 
Sci«ncf. rM4-«7 (Washington, DC: June 1989). 

were over $800 million in 1988. The Federal share capability have been decreasing. In addition, obso- 

of funding wa.s 75 percent in 1958 and now stands at lescence time was 7 to 10 years in 1975, while the 

about 60 percent.**' NSF found Uiat instrumentation 1986 estimate was 3 to 5 years. And these instru- 

costs have increased (in real dollars) for state-of-the- ments require funds for maintenance and operation 

art instruments, but costs for instruments of similar (about 4 percent of the purchase price).'** 



♦^Oovenimcnt-Umversily-Industry Research Roundubic, op. cil., footnote 17, p. 17. 

^'National Science Foundation, op. cil., footnote 19. pp. 1 30- 1 33. The enhanced power or sophi.iticalion of a new laitrvunent. say. an automated DNA 
sequencer, is seen by researchcn ai justifying iu cost, wliich is a relatively modest investment for sustaining, or peitiaps enabling for the first time, the 
performance of frontier science. As Robed Borchcrs. asiociaie duector for compulation at LawreiKe Livermorc National Uboraiory. puts it: "We're 
scientists. When we hear about » faster machine, we're interested." Quoted m Marvia Clemmit. "Uvennore's Purchase of Japanese Supercomputer Is 
Blocked." The Scittuist, vol. 4. No. 23. Nov. 26, 1990, p. 3. 
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Figure 6«6— Direct Costs Awarded for NIH Research Projects, Research Centers, and Other Research Grants: 

Fiscal Years 1979-68 
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87 88 



Projacta 
Othar 



Cantara 



University researchers echo the same concerns 
about research expenditures for equipment: 1) in- 
strumentation is becoming obsolete at a faster rate; 
2) many are buying more computer equipment or 
using a universityv/ide computer system (for exam- 
ple, the University of Michigan spends over $160 
million every year on information systems — 10 
percent of its operating expenses); 3) most research 
fields are becon ing increasingly dependent on 
advances in research equipment; 4) support person- 
nel are required in increasing numbers to operate 
equipment; and 5) maintaining research equipment 
for a laboratory takes a large amount of researcher 
tinie.'*^ 

Research Lxpenditurcs at the 
National Institutes of Health 

llie amount of dolkus awarded for direct costs of 
individual investigator-initiated, or ROL research at 
NIH has risen steadily since 1979. Tl)e direct costs 
in current dollars awarded tliat ycai increased by 



$1,5 billion, or 155 percent, to a fiscal year 1988 
all-time high of $2.6 billion (see figure 6-6). In 
constant dollars, growth was $408 million, or a net 
increase of 41 percent. According to NIH's Division 
of Resear-^ii Grants, the proportion of indirect costs 
to total expenditures has increased in 8 of the years 
from 1979 to 1989, ranging from just under 28 to 
over 31 percent. Nevertheless, when examining 
dollars awarded, and controlling for inflation, indi- 
rect costs are rising at a faster rate than direct costs 
(20 percent higher). 

Personnel expenditures accounted for 65 percent 
of the $3.2 billion direct costs budgeted for fiscal 
ye<u- 1988 ROl reseiuch. The next largest category 
of direct costs was supplies, at 12.4 percent. The 
equipment category has been stable at 5.2 to 5,6 
percent since 1984 (see table 6-3). Noncompeting 
iuid competing continuation grants have higher 
expenditures for persomiel tlian do new grants (68 
and 64 percent, respectively, v, 51 percent for new 
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Table 6-3— Extramural Direct Costs by Budget Category at NiH: Fiscal Years 1979-88 

Total direct All other 



costs (Including 
(In billions Personnel Equipment Supplies hospitalization, 
Rscal year of dollars) (In percent) (In percent) (In percent) In percent) 



1979 $1.4 66.8% 6.2% 13.0% 14.0% 

1980 1.5 67.8 5.2 13.2 13.8 

1981 1.6 68.4 4.5 13.4 13.7 

1982 1.7 69.5 4.4 12.7 13.4 

1983 1.9 69.4 4.8 12.7 13.1 

1984 2.1 68.5 5.2 13.1 13.2 

1985 2.4 66.5 5.9 12.7 14.9 

1986 2.6 67.8 5.3 11.6 15.3 

1987 3.0 65.8 5.8 12.0 16.3 

1988 3.2 64^9 5^6 12^4 1 7.1 



SOURCE: National Institutes ot Health. Extramural Trends: FY 1979-1986 (Washington, DC: June 1989), p. 61. 



grants). Conversely, equipment expenditures are 
higher for new grants than for continuations. 

In recent years. NIH has conducted * 'downward 
negotiations" of noncompeting grant continuations, 
whereby the amount awarded in years after the initial 
award will be less than the original commiUnent.*^ 
This practice has resulted in uncertainty for the 
investigator as to what funding will be available 
from year to year."*^ It has also led to congressional 
criticism of financial planning at NIH (see box 6- A). 

Calculating the Biomedical Research and 
Development Price Index 

The Biomedical Research and Development Price 
Index (BRDPI) is a specialized price index calcu- 
lated since 1979 by the Bureau of Economic 
Analysis of the Department of Commerce for NIH. 
The BRDPI is a fixed-weight index designed to 
reflect price changes of the cost to NIH of supporting 
biomedical R&D. The index is calculated for fiscal 
years and is currently based on patterns of NIH 
obligations for fiscal year 1988^^ (see figure 6-7). 

The BRDPI is comprised of three major subin- 
dices — intramural activities, extramural activities, 
and extramural nonacademic activities. Within each 
activity, price indices are available for major compo- 
nents such as personnel, supplies, and equipment. 
Intramural activities comprise all activities per- 
formed by NIH, including R&D, as well as support 



Figure 6-7— Biomedical Research and Development 
Price Index: Fiscal Years 1979-89 
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functions for intramural and extramural research. 
Intramuial activities are grouped into 27 categories 
tliat correspond to available price measures. 

Figure 6-8 shows a comparison of the aggregate 
BRDPI with three oilier indices — the Consumer 
Price Index, the Producer Price Index, and the Gross 
National Product. The BRDPI has consistently 
increased at a faster late than fJie other three indices, 
but has slowed in recent years. Table 6-4 displays the 
BRDPI for the years 1979 through 1989 (fiscal year 
1988 is the base). In 1989, the index is highest for 



^'Marvin Cassinan, ''Issues Behind the Drop in ihc NIH Award Ralc,•M.9^/^^f>vJ. vol. 56. September 1990, pp. 465-469. U\lc in 1990. the National 
Institutes of Health began consideration of a plan whereby funding adju.<tnienis would be made prior to award and no! through across-the-board cuts. 

'^^In contrast, the National Science Foundation awards a set amount for the grant over a raultiycar period. Any cuts m tlie awards are across-thc-boaid, 
leading to less utKcrtainiy for the granites. Uncertainty has two distinct but related repercussions for principal Investigators: first, their anxiety level 
is raised regarding available njonies for carrying out the next year's work under a muliiyear grant, and second, their planning fot nc<^dcd personnel and 
infrasinjciurc m'jst include several contingencies 

^%ureau of Economic Analysis, op. cit.. footnote 1 1, p 1- 
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Box 6-A— Financial Planning at NIH: A Congressional Mandate 

During its review of the fiscal year 1991 budget for the National Institutes of Health (NIH), the House 
Committee on Appropriations stated that: 

. . . despite large increases in funding for the NIH during the last decade, the system of Federal support for the health 
sciences is in crisis. While the Committee believes that this crisis has been overstated^ it lecognizcs that problems 
with low numbers of new grants, high levels of downward negotiation of grant awards, and the general lack of stabflity 
in government support for the biomedical sciences are critical problems which must be addressed if the vitality and 
the morale of the research community are to be restored.* 
lluis Congress, as it traditionally has done, gave NIH more than the Administration had requested for 1991, 
boosting its appropriation to $8.3 million. But the House and Senate appropriations bills, using sinular language, 
. . excoriated NIH administrators for inadequate financial planning/*^ 
In response to this congressional criticism. NIH drafted a plan for managing biomedical research costs. It was 
circulated among scientific societies and university associations prior to a December 17. 1990, meeting of the NIH 
Director's Advisory Committee to register responses to the plan. Twenty witnesses testified. The NIH plan features 
six goals: 

1 . Set 4 years as the average length of research project grant awards. Four years would allow NIH to provide 
furtding continuity to investigators while ensuring that a greater number of competing awards are made each 
year 

2. Implement cost management measures so that the average cost of research project grants increases at the 
same rate as the Biomedical Research and Development Price Index (BRDPI). 

3. Stop using Uie concept of •'approving" grant applications and adopt the •'success rate" method based on 
the ratio of applications funde<l to applications reviewed— a method used by other Federal agencies, 

4. Fund the number of research training grants recommended by the National Academy of Sciences to the 
extent possible without jeopardizing NIH's ability to provide stipend increases for research trainees. 

5. Manage the growth of NIH research centers by controlling NIH appropriations for centers rather than by 
establishing a ceiling on tlie number of centers. 

6. Increase funding for other mechanisms to reflect inflation.^ 

As pointed out by John Brigg.s, deputy director of extramural research at NIH. who chaired the December 17 



NIH must remain flexible enough to allow biomedical science to respond to public healtli emergencies and 
scientific opportunities, mul lliis is reflected in the pliui. In order for NIH to carry out its mission, each institute and 
CMiter must mamiain a balanced research portfolio with an «4)propriate combination of research project grants, center 
grants, irainmg grants and othtrr mechtmisms. Cost management goals can and should be pursued through a 
combination of peer review actions and administrative conuols/ 

Responses to the NIH plan have been mixed.^ While increases in research project (ROl) grams are attributable 
to iiKTouses in ituiirect costs, * \ . . neither NIH officials nor researchers can pinpoint sfxscific causes for the 
increase/ Linking indirect costs to the BRDPI is more popular llian taking a . . total-cost restraint approach."^ 

his Congress. Hcnisc Cnniniiticc on Appropriations. Dvpanments oflMfjor, Health and Htmuin Servives. and Education, and Related 
AKcnaes Appmpnation Ihll, report 101-591. lOIst Cong. (Washington. IX:: U.S. Govcmn)Cnt Printing omcc. July 12. 1990). p. 51. 

^Oavid L. Whcclei. ' 'NIH Plan Would Tf un Uii^th and Growth of Rcscarcli Grants/* The Chronicle of Higher Education, vol. 37, Dec. 
12. 19^)0. p A2I 

^Buscd on ''NIH AiLswcrs Congress Willi Six-Point Plan," Washington Fax, Dec 18. 1990, p. 1. 
•*nmt..pp. 1-2. 

^Uascd on rcsiwnscs lo a survey coiulucicd by Waxhinfiton Fax and reported Dec. 14 and 17. 1990. 80 pcrceni of ihc rcspotldcnts favor 
a single, agcncywide policy for iniplemcnimg Congress's 4-ycar plan for cost management at tbc National Institutes of Health. 
Indirect Cost l^rnnc Source of Increase in Dollars for KOI Grunts." Washington Fax. Dec. 7. 1990. p. I. 

^WiishinKtnn Fax. Dec 17. 1990 Opp<>sition to srudy section coasideralion of indirect costs is nearly unaninioiw. Sec "NIH lb Focus 
onQmUiy Owcrhiiimbcts,'' Washtntifon Fat, Dec 19. 1^). p I. 
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^ — rimiiMtMiMta^ 



ft powerlU loot. Fskflpi tocMM li^ 

it very siefbi 10 lliiiik lo lerai site 

(mmi." AIM fee BUiabetft Mii,''Bi4ffil lamftM fDr BipicMlcw/' S^fUM, vol No. 9» Mv. 4, 1991» pp. 1. 6. 

lOSoe WatkiHgton Fax, Dee. 14, 1990. p. I^Ar fUtir doiolplldoft of Ihii meetii^ tod tpeciflc potau of oooiealioa. m Biiteni I. 
CulUton* ''Biomedicftl Puodiof: The Eieraal 'CAtiiV' SHma.v^ 2Sa Dec. 21, 1990« pp. 165?«1653i iadPttnetaZum, *'Reie«rchRtiidiag: 
^^H AIn Cott<;onuiA»em nto.'' CA^co^ 
gmutt ciooot be decoupled from tfae duratkm or avenge gmu amooot 

^iPor a discussion of various qHlooi . se<^ Basbara J. Cidliioai Readies Plan for Cost Cootaiomeot.'' Schncit vol 250, Nov. 30. 
1990, pp. 1198*1199. 



extramural activities, specifically nonpersonnel 
(supplies, travel, and consultants) and indirect costs. 
More telling? is table 6-5, which compares percent 
changes from prior fiscal years for 1980 through 
1989. Tliis table shows general slowing of the 
increase in all iu^eas, but most significantly in 
indirect costs for extramural activities. 

Intramural expenditures have increased at a much 
slower rate thiui extramural exj>enditures, due to the 
modest increases in Federal employees* pay z*^* 
Increase^ in intramural expenditures appear to be 
leveling off from the sharp increases of the early 
1980s (see figure 6-9). The aggregate extramural 
activities index has slowed to about a 5.5 percent 



minual increase heading into the 1990s. Extnunural 
activities comprise R&D outside of NIH iuid fi- 
nanced by griuUs to universities and medical 
schools. A siUTiple of universities provides the data 
for this index. Three subindices comprise this 
category— saliu-y and wages, fringe benefits, and 
indirect costs. 

Two sources arc used to compute a wage and 
salary index for each institution: the Report on 
Medical Faculty Salaries, published by the Ameri- 
ciui Association of Medical Colleges, and Academe: 
The Afinual Report on the Economic Status of the 
Profession, published by the American Association 
of University I^ofessors. Salaries for medical school 



^'11)11. p I \ ''he proposiM fisuil yc.ir 1 bu<V.cl c.iIK U)t a 1 ^ pvKcni murasc iii "rcscareh fiuinagcmcni ;uul suppori." which covers ihc- costs 
(»l admini- i-;inj' ihi* Naiinful In.Mitutcs of MiMlth cxiraimiral rvsoan h protrrains. cspccjully the c;?pcn.scs of peer review panels (thai have k¥?cotiie "more 
lar^u uuensive") Keporied m "Wa) s aiid Means. ' Hw i hmnti of Hii:f,. f Jumih^n, \n\ "^V. N(» 2Vl'ch 20. l^^jl.p A2'>. 
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Figurt 6-8-Compari8on of BRDPI With othtr PriM 
IndlMt: Fiscal YMrt 1080-89 



Percent change from previous year 
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KEY: BROPtofilomtdleai RaiMfch and 0«v«fopm«nt Prlc« lnd«x; 
CPI-Contum«r Pric* Index: PPUProduosf Pric* Indtx; GNP-Gro«s 
NttlontI Product. 

SOURCE: U.8. ()«partm«nt of Commwc*, Butmu of Economic Anitysii, 
Oomtdcal Rt$»nh and Davohpmtnt Prtet Indax: Raport to 
Mia National IntllMaa ol Haahh (WMhington, DC: Mar. 30, 
1M0), charts. 

faculty tend to be high and might have a dispropor- 
tionate effect on salary calculations; biological 
scientists (not M.D.s) earn lower annual salaries (8 
percent less) than scientists employed in most other 
fields.*' 

Indirect costs are calculated as a rate applied to 
direct costs. The "quantity" of indirect costs, 
therefore, is vimially impossible to defuie. Accord- 
ing to the Department of Commerce, if indirect costs 
increase as a result of additional R&D, the increase 
is not a price change. If no additional R&D is 
performed, an increase in indirect costs is a price 
change. The criterion used to evaluate a change in 
the c(Hnposition of indirect costs is whether or not 
the change has an impact on the performance of 
R&D. For example, if a university purchases a more 
powerful central computer and the indirect costs rate 
rises because that purchase is allowable as an 
indirect cost, the performance of R&D is probably 
enhanced. OTA finds this exception to indirect cost 
increases problematic, since it is not well defined 
and enhancement of the performance of research is 
not considered in other categories of expenditure. 

For calculation of the indirect cost index in the 
BRDPI, an indirect cost rate index and a direct cost 

*'Tlie number of intdtutioos used to cieate the academic ial»y tod wage price index repreients 96 perceot of total obUgatiofu. Each iudtutioo'i 
Kfantt lalary and wage index is multiplied by its weight of obligadoas derived from the National Institutes of Hefllth (NDf) HUPAC flle, which contains 
data on all NIH awards for direct and indirect cosu. These weighted data are fummed to create the Academic Salary and Wage Price Index. The source 
used to create ttie fringe benefit index Is Academt. Again, a fringe beoeHt nue iudex is created for each research institution. See Natiooal Science 
rouodadoa, Proflles—Siohgical Scienctt: Human Resources and Funding (Washington. DC: 1989), p. 9. 



KEV; N»1-Natlon«l InatilutM of Health. 

SOURCE: U.S. D«partm«n( of Commare*, Butmu of Economic Analyala, 
OornadM Raaaarch and Davlopmanl Prha Max: Raport to 
#w NaUofuH ln$tlMaa ol HaaHh (WasNnoton, DC: Mar. 30, 
1090), chart 1. 

index are computed. These two indices are then 
multiplied together. The calculation of the BRDPI is 
conducted every year with the base year scheduled 
to be reset in 1992. 

Research Expenditures at the National 
Science Foundation 

Data are available on research expenditures 
funded by NSF up to fiscal year 1989. Expenditures 
are reported for the conduct of research, which 
includes basic, applied, and development: for R&D 
facilities, which include land, buildings, and fixed 
equipment; and for major equipment. The portion of 
the R&D budget allocated to facilities has been at 
less than 1 percent for the past 10 years, until the 
addition of a facilities funding initiative in 1988. 
Direct costs are available for personnel, R&D 
facilities, equipment, and instrumentation. Other 
direct costs are reported in the aggregate, but include 
supplies, publications, consultants, computer serv- 
ices, subcontracts, travel, and fringe benefits. This 
category accounts for over 27 percent of the budget. 

At NSF, equipment has risen from 9 percent of tlie 
R&D budget in 1981 to over 13 percent in 1989. 
Personnel has accounted for about 40 percent of the 
R&D budget over the last decade. Indirect costs have 
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Tabf« 6-4— Blonrwdieal R«SMrch and Dovolopmant Price Index: Fiscal Yaara 1979*89 (ises s lOO) 
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SOURCE: U.S. D«partm«nt of Comm«rc«, Bureau ot Economic Anatysli, BlomtdiCMl Rtatvch and Davtlapnmi Priot Indtx; Rtport to 0i« NMiontl InaOtutm of H§ulth (Washington, DC: Mar. 30, 
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Table 6-&— Biomedical Research and Development Price Index: Percent Change From Prior Fiscal Year, 

Fiscal Years 1980-69 
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SOURCE: U. S. Dtp«rtm«nt of Comm«rc«, Bur««u of Economlo Analysis. Biommiic^ RssBMfch Md D^vhpnwnt Prl€0 Ind^M: Report to th0 NMthn^ in9tiM9$ 
ofhMlh (Wuhln^ton, DC; Mar. 30. 1990). tabia 2. 
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fluctuated around 25 percent over the past 10 
years.^ Hie Academic Research Facilities Moderni- 
zation program, authorized in 1988 as part of NSF's 
S-year reauthorization, committed up to $80 million 
in fiscal year 1989, but no funds were appropriated 
for it in that year. Funds were finally obligated on 
September 1, 1990/' 

Trend data on research expenditures administered 
by NSF are spotty. Expenditure data are readily 
available but do not provide a sense of actual costs 
incurred (or shared) by the researcher. While NSF 
routinely collects aggregate data on R&D spending 
and expenditures across the Federal agencies, its 
own databases are not nearly as comprehensive as 
those kept by NIH. 

The Research Performer's Perspective 
on Expenditures 

The deflnition of ' 'research performer" has many 
components. The most obvious is the researcher or 
team in a university, industrial facility, or Federal 
laboratory. Another level is the department or other 
organizational unit within a university or laboratory. 
At the most aggregated level are the laboratories and 
universities themselves. Given the concentration of 
research performance in universities, most expendi- 
ture data are based on this sector. 

The Federal Government supplied $9.2 billion in 
research funds to universities in 1990. Indulstry 
supplied $1.1 billion and another $1.1 billion came 
from nonprofit institutions. Between 1978 and 1988, 
the average annual growth above inflation was 5.5 
percent (see figure 6-10). Industry has provided most 
of the increase in funds, since growth of industrial 
funding for university R&D averaged 12 percent 
above inflation per year during that time period. 
Funding from nonprofit institutions increased annu- 
ally by an average of 8.2 percent in real terms over 
that period, and the Federal Government increased 
its support of university R&D by an annual average 
of 4.6 percent above inflation. (Figure 6-11 presents 
FederiU basic research by performer.) 

Since the l%0s, the Federal research system has 
changed in many ways, not the least of which is in 
the nature of the research performer. For instance, 
during the 1960s, a professor with two to six students 



FIgurt 6-10-Growth In UnlvtrtHy and Celltfl* R&D 
P«rfomMnet, by Soure* of Funds: Fiscal Ysars 
1976^ (bSMd on conttmt dollars) 

Average annual percent change 
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*Exclud«i gwiml-purpM* Stat* or local govammant apprepriatlona that 
unlvaraltlat uta at thair diacratlon for R&D. 
NOTE: Flguraa wara eonvartad to constant 1682 dollars using tha QNP 
Implicit PrteaOaflstor. 

SOURCE: National Sdsnca Foundation, fMlonai Psttma of RAD Rt- 
touicm: 1900, final raport, NSF 00-3t6 (Washington DC: 
1M0). chart 13. 

in one discipline at a major research university was 
the most prevalent production unit of research. In the 
1990s, many other types of research units exist, in 
particular much larger research groups with many 
graduate students, nontenure track researchers, post- 
doctoral fellows, and technicians under one princi- 
pal investigator. The rise of centers and university 
research institutes now augments the traditional 
array of disciplinary "departments'' (see chapter 7). 

Similarly, the number of universities and Federal 
laboratories that conduct research has grown, ex- 
panding the group of researchers that pursue special- 
ized fonns of inquiry in the research system. These 
changes have occurred primarily to accommodate 



^National Science Poundstion Iwdgct office, pcnonal coimnunicadon, July-Augiwi 1990. 

<1n January 1991. the Nitional Science Foundation announced the 78 research imtitulions awarded a total of $39 million under thii program. See 
ConJiance Holdcn, "Facililjcs Awards,'" ^deflce. vol. 251. Feb. 8. 1991. p. 622. 
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Flgur* 6-11— F«df rally Fundtd Basic Rtsaarch, by 
Parformar: Fiaeai Yaara 1969-90 
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OaMfcomant OateXad mtodcti faWaa; fl$c»l Y—n 1855- 
f 90O(Waihlngton, DC: 1080), tabia 27; and National Sdanca 
Foundation, Stlntmd Data on F*d*r»l Fundi tor Rn$vch 
md Dtvktptrmt: FitctI Ysan f 099, f 090 mid 1991 (Waah- 
Ington, 00: Oaoambar 1M0), taWa 1. 



growth in the system.'^ The annual rate of growth for 
doctoral scientists and engineers employed in insti- 
tutions of higher education from 1977 to 1987 was 
just under 3 percent.^' Some universities are feeling 
the strain felt by the scientific community, claiming 
that capita] needed to fund renovations and new 
construction, equipment, administration, and per- 
sonnel are rarely fully recovered through Federal 
funds. 



Components of Research Expenditures at 
Universities 

lb document the effect of the research economy 
on changing university and laboratory structures, 
and to complement the Federal perspective pre- 
sented above, OTA visited a public and a private 
research university — the University of Michigan 
(UofM) and Stanford University (SU) (see box 6-B). 
In addition, OTA visited at least one laboratory for 
each of the five major research agencies with 
intramural laboratories. However, expenditure data 
are scarce at the Federal laboratories and not 
uniformly collected. This section, therefore, dis- 
cusses the performer's perspective on expenditures 
(with details derived from the two universities), and 
then outlines other issues that also influence spend- 
ing in the conduct of research. 

Both UofM and SU show evidence of robust 
research organizations, with excellent human re- 
sources, facilities, and financial support. This is as it 
should be in a top-ranked university with a long 
history of success (see box 6-C). Nevertheless, there 
was evidence of stress in the research environment 
at both institutions, although it was unclear whether 
this was a new phenomenon. Researchers said they 
were * 'running harder just to stay in place.'* 
University administrators wondered whether their 
institution could continue to expect resources to 
flow from the Federal Government, student tuition, 
and State and private sources.'^ Graduate students 
worried about whether their careers could ever be 
like those of their mentors. 



Salaries 

University personnel spoke of the rising competi- 
tion for faculty with other sectors of the economy, 
and noted that faculty salaries have been rising 
significantly over inflation during the last decade. In 
1988 dollars, the average salary and benefits for a 
full-time equivalent principal investigator in die 
natural sciences and engineering increased from 
$59.(X)0 in 1981 to $70.(X)0 in 1988. Before the 
1980s, growth occurred much more slowly from 
$51,000 in 1958 (1988 dollars) to over $60,000 in 



»Se« Roger L. Oclgcr. "The American UnJveriity and Roearch," The Academic Research Enterprise Within the Indusirialittd NaHont: 
Comparative Perspectives, Oovenuncni.Univerilty.Indujtty Research RoundUble (cd.) (Wajhington. DC: National Academy Preai, 1990), pp. 15-35. 
''National Science Foundation. Science and Engineering Personnel: A National Overview, ipecial report (Wiahlngton, DC; 1990). 
"Alw fee Susan TIffl. "Hard Times on the Old Quad." Time, Oct. 29, 1990. p. 92. 
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Box 6-B— OTA Interviews at Two Universities 

lb explore peiformer perspeciives on reiearch expendUurei and on Federal research IniUativet, OTA chose 
one public and one private research univenity for indepth smdy: the Univenity of Michigan and Stanfbrd 
University. OTA purposely selected two research institutions perennially in the top 10 of those receiving Federal 
research dollars, because of the breadth of research perfDrmed on campus. Also, the problems foimd at these 
universities in sening expenditures and expanding flexibility are thought to be indicative of problems on other 
research«intensive campuses. 

In addition to receiving financial and personnel data from each university, OTA interviewed members of die 
administration, faculty, and graduate student population on campus. The interviews centered on two themes: 1) 
research expendinues, and 2) flexibility of the university and its departments to adapt to the changing Federal 
Amding environment. Other issues discussed included the status of nontenure track faculty, hiring projections for 
individual departments, tenuie promotion standards, and the graduate student perspective on careers in different 
fields. 

The interviews sampled the nuige of personnel on campus. For example, at Stanford, OTA interviewed the 
president (Donald Kennedy), the dean and associate dean of research, two department chairs, three professors, three 
associate professors, one research associate (noMenure track), one postdoctoral fellow, two graduate students, the 
director and other members of the Sponsored Projects Office, the assistant controller, specialists in the Office of 
the Budget and the Office of Ibchnology Licensing, and the director of the Stanford Synchrotron Radiation 
Laboratoiy. The interviewees were selected from a number of disciplines, including the physical sciences, 
engineering, medicine, and the social sciences. At Michigan, a similar set of interviews was conducted 

OTA summarized the findings at each university and distributed the summaries to the campus hosts for 
comment. Select findings are used throughout this report, especiaUy in this chapter. 

SOURCB: OTA interviews. Ju]y*August 1990. 



tile e{u-|y 1970s, but sahu-ies rece('cd slightly in the 
late 1970s to $59,000 in 1981*3 (see figure 6-12), 

Universities jire encouraged by faculty attempts to 
leverage their time with the help of postdoctoral 
fellows, nontenure track researchers, iuid graduate 
students who are paid mwlest sahyies, Hecause of 
the shortage of faculty positions for the numbers of 
graduate students produced, young Ph.D.s have been 
willing to take these positions in order to remain 
active reseiu-chers, This availability of "cheap 
labor' ' is seen by many senior reseiu-chers as the only 
way they ciui make ends meet in comjjeting for 
griuUs.^'* 

Academic Facilities 

Academic administrators claim that with growing 
frequency aging utility systems in laboratories iuid 



classroom buildings falter and bre.'ik down.'* A 1989 
Coopers iuid Lybrand study found that: 

• Since 1950. the facility space in colleges juid 
universities has quintupled, representing some 
3 billion square feet of classrooms, libraries, 
dormitories, offices, laboratories, and other 
space. Not all of this space was built to last. In 
particuhu-. during the 1960s, miuiy .suboptimal 
buildings were erected, in the rush to meet the 
demand from the "baby boom" generation 
entering college. 

• llie capital renewal and replacement needs of 
U.vS. colleges and universities are roughly $60 
billion, of which .slightly over $20 billion is 
"urgent" — requiring attention within the next 
.several yems. (My $7.2 billion of the urgent 
category was targeted to repair facilities in the 



^'Scc Ciovciiimcni-UiiivLTsiiy lndusiry Reseiirch Roumliahlc. op cil., tooliiolc 17, p 2-.U 

'■U-.-«hi»r cconoiiiisi Aliin I'cchlcr (cxctulive (liietlnr, OfUcc o( Scicnlific and Kiiginecriiig Fersonncl, National Rese«rrh Council, personal 
conniiuiiicalion.Nov. 15. 1'WO) writes: '• pcisomicl costs coiwtituic roughly 45 pcrcciilof toul tuslsaiKl . . . this percentage has rcinaincti rcasomibly 
stable over nine Oivcn ihat salaries of f.ituliy (i c . principal invc.sti{!.iiors) liavc bc«;n rising during the I'iSOs, this suggests thut the staffing pattern of 
research projects lias been changing, with the input of f'ls decreasing relative to . other, less expensive ri sourccs. There is some evidence to suppoit 
this hypothesis in the report ot OlURR (thai) tinds In acadeniiu an iiierea.sing ratio of nonfaculiy to faculty " Sec also ihid 

^'Karen ( inissinuck. "Colleges Scr.-uiible lot Money to Reduce Huge Maintciiiince Backlog. Estimated to lixcecd i70 Dilliiin, New I'cdcraJ Help Seen 
Vn\ikc\y," The Chnmu le of Hinher t:juiiiiiiin.vo\ 37. txi 10, 1*W<), pp Al. A.U 
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Box 6-C---Federai Funding at Two Universities 



The University of Michigan (UofM) and Stanford University are in the lop 10 universities receiving Federal 
funds. UofM was ranlced fifth and Stanford was second in fiscal year 1988. Over the past decade, both universities 
have been the recipients of large (real) increases in total funds and Federal research dollars. For example, in constant 
(1980) dollars, UofM total revenues have risen from $600 million in 1979^80 to nearly$l billion in 1988-89 ($1.5 
billion in current dollars). 

From 1979 to 1989, Federal research funds for UofM rose from $117 million (17 percent of total revenues) 
to $188 million (13 percent of total revenues) in constant 1986 dollars. In the period from 1976 to 1986 at Stanford, 
the totiU Federal R&D obligations to the university rose from $122 million to $194 million (1986 constant dollars). 
In addition, from 1973 to 1986, the funds available to principal investigators (Pis) to spend directly on research 
activities grew after inflation at an average annual rate of 2.6 percent. 

The Department of Health and Human Services (HHS) is the largest Federal funder of research and 
development (R&D) at both universities ($124 million at UofM and $170 million at Stanford in fiscal year 1989). 
At UofM, HHS is followed by the National Science Foundation (NSF~$24 million), the National Aeronautics and 
Space Administration (NASA~$13 million), the Department of Defense (DOD-^10 million), and the Department 
of Energy (D0lv~$9 million) in fiscal year 1989. At Stanford, after HHS comes NASA ($50 million), DOD ($45 
million), DOE ($45 million), NSF ($30 million), and the Department of Education (EI>-$10 million) in fiscal year 
1989. From 1973 to 1985, Stanford's share oftotal Federal R&D funding (across all agencies) has remained arcHUid 
2.7 percent. 

Proposal Success Rates 

Stanford and UofM, like most top 10 universities, have a higher proportion of awards per proposals submitted 
than the average for other research universities. For instance, aitiiough UofM does not track its proposals directly, 
it estimates that two out of three proposals were awarded ftinds. At roughly two-thirds, its ''proposal success rate" 
is at least twice the national average of 20 to 35 percent for all proposals (with the exact percentage dependent on 
the agency). 

Roughly the same proposal success rate is found at Stanford, although they distinguish between ''new 
proposals* * and * * renewals. ' ' For new proposals in 1 989-90 (453 proposals sampled), DOD fimded 35 percent; NSF. 
36 percent; ED, 37 percent; DOE, 41 percent; HHS, 52 percent; NASA, 52 percent; and 57 percent averaged for 
all other agencies. Renewals had much higher success rates (470 proposals sampled): HHS funded 67 percent; DOD, 
75 percent; NASA, 80 percent; DOE, 81 percent; NSF, 81 percent; ED, 100 percent; and 66 percent averaged for 
all other agencies. 

Indirecl Costs 

At UofM, growth in the indirect cost expenditures for the university as a whole grew at an annual compound 
rate of 10.3 percent from 1979-80 to 1988-89. However, indirect costs for organized research did not rise as 
quickly— at a compound rate of 9.1 percent from 1980-81 to 1988-89. Although the cost of maintaining buildings, 
equipment, and plant operation for organized research were higher than for other buildings at the university, student 
services, libraries, and sponsored project research expenditures were tower. 

In the early 1980s, the UofM negotiated indirect cost rale (ICR) for research underestimated the *'mic" rate 
by as much as 20 points in 1 year (1984-85). (Note that the cognizant agency for UofM is HHS, which traditionally 
allows lower ICRs than DOD.) At present, the negotiated rate of 58 percent only slightly underestimates the *'true" 
rate of 60 percent, even though a 58 percent ICR is the highest of all public universities. | 

Stanford's ICR was raised from 69 percent to 74 percent in 1987. However, this rate is currently under 
investigation by the Office of Naval Research (ONR) and the House Committee on Energy and Commerce.* 
Although Stanford's ICR is high, it is comparable to rates from other private research institutions. Including Cornell 
University which has an ICR of 74 percent and Yale with an ICR of 72 percent. 

In response to complaints about the high ICR and the rising tuition, expenditures incurred by the 1989 Ixitm 
Prieta earthquake, and the lower than anticipated federally sponsored research, Stanford has embarked on a | 
cost -cutting campaign, li will cut $22 nullion over 1 8 months out of a $ 1 75 million administrative operating budget, i 



*Scc Marcia Bitrinaga. **Sl:uiford Sails Inio a Slofin." Science, vol 250. Dec 2\, 1990. p. 1651; "Govcnuncnl Inquify." Stanford \ 
()h\er\i'r, NovenilJcr-Occcintwr I9<X). pp I. 1 3. mid Marcia Baniiiiga. '*Mm DiiigcU "Ikkcs on iimUmU * Science, vol. 25 K I'cb. 15. 1991. pp. i 
714^717 I 
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Saiariet 

Salaries at both UofM and Stanford have risen above inflation over the past two decades (exact flguies were 
not made available td OTA). Both insthutions state that higher salaries aie required to attract fiMidty. Estperiments 
with congrusionally imposed (now rescinded) salaiy caps at NSP and the National Ihstitutet of Health, which 
provided upper limits on annual investigator sataiy rates dttiged to research gnnta (even though only a few months 
of support may be sought in the grant).affBcted both universities. (Note that Acuity werenot required to reduce their 
salaries as the univenity made up the difference.) For example, if every facuhy member at UofM had an NSF gruit, 
then one-quaiter of the faculty would have been affected by the $95,000 salary cap. 
Facilhies 

Over the last 15 years, UofM has completed nearly $1 billion in new construction and m^jor renovation. The 
amount of building space on campus totals over 22 million square feet. Many of the structures date to before 1950, 
and no building is "temporaiy.** Also, the university has demolished veiy few permanent, older buildings. Since 
the 1960s. Federal and State funds have been limited for facilities, and expansion has occurred slowly at UofM 
compared with other univenities around the country.^ Recently the university has been outfitting buildings with 
energy-efficient equipment, such as new thermal windows. Also, environmental regutations have required some 
improvements. For instance, a large effort to install or replace fume hoods is under way. 

At Stanford, an ambitious new construction proJect-Hhe Near West Campus— 4uu( begun, lliere are pUms for 
at least five new buildings, providing primarily state«of«the'art biboratory and office space. Most of the Ainds for 
construction are from private sources, but if measures are not taken (such as a successAil cost'cutting campaign, 
or an adljustment of the ICR by ONR), Stanford's indirect cost rate could rise to account for the depreciation of the 
new buildings. 

Both Stanford and UofM question their abilities to meet their perceived need for new and renovated buildings. 
Each would like to see an expanded Federal facilities program for academic research. 
Projections for l^uture Federal Support 

UofM and Stanford project an overall slowing of growth in Federal R&D support. Whereas both universities 
had come to expect a 10 to IS percent increase per year during most of the 1980s, the increase in FedenU fUnds at 
Stanford in 1989, for example, was 9 percent. University personnel forecast that simiter limited growth will continue 
into the 1990s. Adjustments will have to be made on both campuses to accommodate slowed growth in Fedoal 
funding. 



^o(e Uut (be uoiveniiy tytiein in Michigan expanded to oiiw umpuiet in Michigan daring (he college boom in tbe 1960s and I970i. 
Most of Omc saleUite campusei have lioce cloied, 



Nation's major resciirch universities. Most of 
these needs, therefore, exist within other aca- 
demic sectors, including liberal (u-ts and com- 
munity colleges, 

Many claim that facility reinvestment has not kept 
pace with growing rieeds, and Coo|x;rs and Lybnuul 
estimate that for every dolhu^ apeM on maintenance 
and replacement. $4 arc deferred. Tliey further 
estimate that current costs to replace a laboratory arc 
roughly $2(X) per squiye foot, while classrooms 
require less than $U)0 [Kr .square foot. 



However, the picture is not as clear as the above 
data would suggest. When asked by NSF if their 
facilities arc poor, fair, good, or excellent, a majority 
of the research administrators and deans at the top 50 
research universities replied that their facilities were 
"good to excellent," whereas a majority of the 
reseiu-ch adiTsinistrators and deans in the schools 
below the top 50 estimated that their facilities were 
"fair to poor." Tlie average top 50 university will 
spend $1 to $2 million or more on facilities each 
yeiu-, while the schools below the top 50 will most 
often spend less thiui $1 million. For public universi- 
ties, 50 to 60 percent of these funds come from the 



^Thf Dfc (ivini; Anifru un ( ampu t A Tu kina Time Uomh is u joini report ol ihc' Asswunon of Physical Plain Adiiiimslnilors ( APF'A) of Universities 
arul C'nllcgci ;uul the Nalioiml Asstxiation of College and University Business Officers in cooperation with Coopers and I.ybrand, autfiored by Scan 
C Rush and Sandra L Johnson, APPA <Alex.uulria. VA, 1 989) APPA's most recent ' deferred maintenance" cost eslimaie is $70 billion Also in 1990. 
42 pcfccm of college and university presidcnis surveyed by the Anienciui Council on Educalion called dcfcrTcd inaiiilcrwncc a key campus issue for the 
iKAl ^ year', up from 14 pcrceni in I9H9 Se* ihid , p. AM. 
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Figura 6-i2~Avtrag« Salary and Banafits Paid 
Aeadamie Ph.D.8 In Natural Sclaneas and 
Englnaoring: 1958-88 
(In thousanda of 19BB dollars) 



1988 dollare (in thoutands) 




1958 1963 1968 1973 1978 1983 1988 



NOTE: Ccnttant doHart w«r« calcuiattd using th« QNP Implldt Price 
Dftflalor. 

DEFINITION OF TERMS: Acadtmlc Ph.D.t In 1h« ruturftJ tdsncM and 
•nglnaarlng Induda acadamlo ampioyMa wtx) hava baan awardad 
tha Ph.D. dagraa In tha following flafdi: Ufa sdancaa, Indudlng 
agriculturaL bMogleal, madlcal.and Q<har haallh aclancaaiphyticaJ 
adanoat, Including astronomy, chamlstry, and physios; anginaar- 
Ing.lndudlng aaronautlcalandaslronaullcat. d^loal. dvil. alact ri* 
cal, and machanlcal anglnaailng; anvlronmantal adsnoea. Indud- 
Ing ocaanography, and atmosphaHc and aarlh adancas; and 
mathamatics and computar adanoa. Including all flakto of matha- 
matioB and oomputar^ralatad adancas. Gompansatkm indudas 
sataHaa and fringa Nnallts. ind\«ding inauranca and ratlramant 
contributions. 

DATA: Natlon^il Sdanca Foundation, Division of Pdlcy Rsaaaroh and 
Analysts. Databaaa: CASPAR. Soma of thM data in this databasa 
ara aatlmataa, Inooiporatad whara thara ara disoontlnultlas within 
data sariaa or gaps In data ooKactlon. Primary data sourca: National 
Sclanoa Foundation, Division of Sdanca Raaoucas Studios, 
Survay of Sdantlfio and Enginaaring Expandlturas at Univarsitlaa 
andCollagaa;Natlona}|nstit».itaaofHaalth;AmaricanAsaodaticnof 
Unlvarsity Profaaaors; National Aaaodation of Slata Univar sitias 
and Land^rant Collagos. 

SOURCE: Oovsrnmam-Univarsity*lndustry Rasaarch Roundtabla. Sc/- 
aooa and T^chnofogy in tfta Acml^mio Ent§tpri§0: Status, 
Trench andlaBum (Washington. DC: Nationai Acadamy Prasa. 
19a0).flgura 2*47. 
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Research universities support nnany facilities devoted In 
part to researcti. auch ad the Seeley 0. Mudd Chemistry 
Building at Stanford University pictured here. 

States and 30 percent from bond issues. For private 
universities, roughly one-third comes from the 
Federal Govemment> while another one-third is 
from donations. 

The crux of the facilities problem is that academic 
centers can always use new or augmented buildings, 
but how much is enough? One method to judge 
would be based on the research fostered by each new 
facility. Unfortunately^ there is no acceptable 
method to measure the quality or quantity of 
increased research capabilities or of ^'missed'* 
research opportunities. Even though '^need'* may 
not be quantified in the different sectors of the 
research enterprise a demand certainly exists. For 
example^ when NSF solicited proposals for a $20 
million program in 1989 to address facilities needs, 
it received over 400 proposals totaling $300 million 
in requests.^'' 

Historically! the Federal Government has never 
been the primary source of funding for academic 
facilities, conceding support to private donors, 
States, and localities. Indeed, the proportion of 
Federal monies out of all the monies spent on 
academic facilities has never topped one-third. Now 
it is less than 10 percent.^^ 

The issues sunounding the research infrastructure 
are complicated. There is a need for improvement — 
as evidenced in many research environments — but 



^^Michscl Dsvcy, Brickj and Mortar: A Summary and Analysis of Proposals to Meet Research facilities Needs on College Campuses (Wastiingtoc« 
DC: Coogreuiofial Research Service, 1987). 

^Tbc NatiomJ Science FoundMion program also reqairci a SO^SO matcli for requests raxiging from $100,000 to $7 million. vSome. incfuding (he 
Presi(tei}l*s Science Advisor, estimate the price of academic facilities roodiirnization to be $7 billion. Sec Jeffrey Mervis. * 'Institutions Respond in Large 
Numben lo Tiny Facilities Program at NIH, NSP." The Scientist, vol. 4, No. 8» Apr. 16, 1990. p. 2. 

^^vey, op. cit., footnote 57. 
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the need is very hard to quantify or assess. In 
addition, the extent of the Federal role--«hould there 
be a Federal facilities program?— -is in question. Do 
deteriorating facilities affect the quality of research 
underwritten by the Federal Government? Academic 
earmarks for facilities continue to play an ad hoc role 
that unfortunately fails to address the facilities 
renovation issue directly or systematically (as a 
formal Federal facilities program perhaps would, see 
box 6-D). 

Indirect Costs 

One of the most worrisome issues on many 
research campuses is the high cost of ' 'overhead" or 
indirect costs. As part of the "full cost recovery for 
research" doctrine in the Federal Government, 
universities charge the Federal Government for 
facilities maintenance, administrative expenses, and 
other expenditures that ensure their capacity as 
research performers but cannot be directly associ- 
ated with specific projects. The standard procedure 
is for the university to negotiate a single rate that will 
be charged to all Federal grants with the cognizant 
Federal agency (either the contract audit agency of 
the Department of Defense or the Department of 
Health and Human Services, depending on the 
institution).^ For example, in 1990, Stanford Uni- 
versity charged 74 percent in indirect costs to every 
grant, so a grant of $ 1(X),000 in direct costs might be 
submitted at a total cost of up to $174,(X)0.^> 
(Overhead can be computed on only certain direct 
costs, resulting in a total charge to the government 
of less than $174,000.) Indirect cost rates have 
evolved over the last 30 to 40 years, and clearly 
reflect institutional idiosyncrasies and practices of 
the cognizant ageucy. 



Over the past three decades* indirect costs have 
claimed a much larger proportion of academic R&D 
funding. In 19S8, federally reimbursed indirect costs 
comprised 10 to IS percent of academic R&D 
funding. By 1988, that share had risen to roughly 25 
percent.^2 In addition, some agencies allow more in 
indirect costs. For example, in 1988, the indirect cost 
as a percent of the total R&D expenditures at NIH 
was 30 percent, whereas it was less than 24 percent 
for NSF (a proportion unchanged since the mid- 
1980s).^3 Medical schools typically have high indi- 
rect cost rates, both because of the extra facilities 
expenditures associated with their activities and 
because they tend to be associated with the research 
universities that have high indirect cost rates.^ 

The indirect cost rate at the University of Michi- 
gan is 58 percent, which is high for a public 
university. Because the State assumes part of the 
cost of maintaining its universities, the indirect cost 
rates are usually lower than at private universities. In 
addition, at State universities, indirect cost monies 
are often transferred directly to State coffers, so that 
the university has little incentive to pursue a higher 
indirect cost rate or to employ the aH.niinistrative 
personnel needed to comply with Fe^jleral audit 
requests to justify new rates. 

Many university administrators report that the 
monies received in indirect costs do not cover their 
expenditures. They worry about further erosion of 
the indirect cost base, due to the perception in many 
quarters of high rates of overhead and resistance to 
the indirect cost increases experienced by many 
universities over the last decade." The chief recom- 
mendation offered by a 1988 Association of Ameri- 
can Universities report was that the indirect cost rate 



*CAsfocl«tion of Ameilcaa Univenltiet. op. clt., foocnole 14, p. 7. 

« As « result of tbe Defense ContMctor'i Audit Afeocy 'i (DCAA; ongoinf investigitioo of Slanford'i indirect cott nte, $a interim nte of 70peneot 
hMbeenocgotlcleduof Feb. 1, 1991. WUlitm Muiy, Stanford UnWertity, penooal communication, Febnury 1991.DCAA'ipieUffllnaiyanalyiii 
indicate* that Stanford, which requested a new indirect cost rate of 78 percent, could JustUy only a 62 poccot rate. Stanford has yet to rebut this claim 
Sec Mkrcta Barinaga, 'Was Paul Biddle Tbo Tbugh on Stanford?" Science, vol. 231, Jaa 11. 1991, p. 157; Kenneth J. Cooper, "Stanford Will Try 
to Explain Price of Knowledfe," r** Wathingm Post. Mar. 13, 1991, p. A13; and Kenneth J. Cooper, "Panel Looki forLiabUltv ioSUufoidBUliuts 
C$ie,"TtuW<uhingfonPoti,Mu, 15, mi, p. /ai. 

•'National Science Foundation, op. cit„ footnote 19, p. 121, 

<^Ibid.,p. 142: and Association of American Universities, op. cit., footnote 14. For example, restricting payment for overhead expenses to 14 pereem 
on research projects funded by the Department of Agriculture hu aroused concern that universities would have to decline such awards shice they could 
not afford to do the projecu. Fears that such an across-the-board ceiling could be instituted at other agencies continue to mount. See Colleen Cordes. 
• 'Unlvenities Fear That U.S. WiU Limit Paymenu for Overiiead Cosu Incurred by Researchers,' ' The Chronicle cf Higher Education, vol. 37, No 12. 
Nov. 21, 1990. pp. AI9. A2I, 

•♦William Massy, vice president for finance. Stanford University, personal communlcaiion, March 1991. 

«S"Dingell Asks Defense Contract Audit Agency to Brief Suff on Stanford Overt>cad Expenses." Washington Fax, Dec. 10, 1990. Also, see Susan 
Ttffl. "Scandal in tbe Uboratoriea." Time, Mar, 18. 1991, pp, 74-75; and Kenneth J. Cooper, "Five M^r Unlvenities Face OAO Audit of Reaewcb 
Bills." The Washington Pott, Mar. 16, 1991, p. A2. 
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Box 6-D— A Federal Research Facilities Program? Perspectives From Academia 

In August 1990i University of Wisconsin at Madison Chancellor Donna E. Shalala wrote to President Bush 
urging development of a comprehensive plan to finance university research facilities. She stated: 

I recognize that theit are a number of important competing claims on the Federal budget, even from the academic 
cominunity . However, a planned Federal strategy at this stage can well save us money in the long run, and make more 
effective our other investments in science and engineering research and training.' 

Even if money were appropriated to a Federal facilities program, there would be tough choices, such as an equal 
distribution of funds by category of institution or some weighted scheme that favors research-intensive universities.^ 
Stanford's fonner Vice President for Finance, William E. Massy, outlines the following possible pitfalls:^ 

What would happen if research sponsors were to shoulder the load of paying for needed university science 
facilities? . , . Research sponsors might adopt the "pay-now" strategy and provide the needed $5.85 billion up front. 
Congress is considering a facilities grant program, but it is hard to believe that anything like this amount could be 
provided over a few years without huge inroads on operating funds for research. 

On the other hand, if the * 'pay-later* ' strategy were adopted by sponsors, institutions would have to come up with 
up-front money on their own and then try to recover it through tlie overhead rate. This could be done in one of two 
ways: 1. Use gifts, institutional funds, or State appropriations ^2. Use debt 

Providing direct grants for facilities is an anractive option on its face, but . . . amounts would probably be modest 
in relation to need because of the [Federal] deficit. There Is a real danger that appropriations would be at the expense 
of operating funds for science — One reason for favoring a grant program is that it makes facilities available to 
institutions that arc unable to provide up-front funding. ... But it is precisely the institutions that have not yet been 
successful in merit-reviewed scientific competition that have the most need for a facilities grant program and would 
benefit most from it 

Facilities funding on a ••pay-as-you-go" basis through the indirect cost rates puts the bunJen . . .on die 

instinitions, and Uien reimburses them for sonK or all of the present value of these outlays Indirect cost rates 

would rise, . . . [and] institutions would have to bear the risks that a facility , once constructed, could not be filled with 
sponsored research at full overhead recovery. (ITw Federal Govemmcnt takes that risk in an up-front grant 
program.) . . . 

WJiile the Federal Government would be unlikely to announce a ••won't pay" policy, that could happen by 
default if deficit reduction, ••no new taxes." social programs, and defense come to dominate tlie need for university 
science facilities. A ••won't pay" policy would preclude facilities grants, and it might also open tlie way for caps on 
indirect cost rates and elimination of universities* tax benefits . . . 

When the scope of a problem is unknown, as with the need for academic research facilities, questions of which 
is the most appropriate policy is even harder to answer. To this end. a six-university consortium, called the Center 
for Policy Research and fJducation. has been established to study university finance and cost containment, 
investigating • •. . . growth by substitution rather than by adding on cost. * *^ In the meantime, neither universities nor 
the Federal Government face the prospect of easy solutions. 



'Ouolcd in Karen Grassniuck, •'Colleges Scramble for Money io Reduce Huge Mainiciuincc Backlog. Rslimatcd lo Exceed $70 Billion; 
New Federal Help Seen Unlikely.'* Thf Chromvle ofHij^her Eduvunon. vol. 37. No. 6, Oq\. 10. 1990. p. A34. 

^Ihcr administralivc qucslions include: a .single program or a line iiem in (he budget of each research agency, a separate amount for repair 
am; renovation v. new construction, and an institutional matching requirement. For furtha discussion, see GovenmHsni-Uiuversity-lndustry 
Research Roundlable, ^ Research Facility Finaiicing: Ncar-Tbrm Opiiow.*' working draft, February 1991. 

^Drawn from William l\. Massy, •'Capital lnvesm)eni for the Future of Biomedical Research: A University Chief Financial Officer's 
View/* Academic Medicine, vol. 64, 1989. pp. 435-437. The dollar estimates for coastruction he cites are drawn from National Science 
Foundation. Scientific and Enmeerinf^ Research Facilities at Universities and Colifges: 1988 (Washington, DC: 1989). 

'^On tlie cosi-efficlefKy of academic fundraising, see Li/ McMillen, ' A Study to Delenninc the Cost of Raising a Dollar Fiml/j Tliat 
Average College Spemis Just 16 Cents," The Chronicle of Higher Education, vol. 37. No. 1. Sept 5, 1990. pp. A31-32. 

5sec "Education Finance,*' Stanford Observer. November-December 1990, p. 14. The Department of Iklucation's Office of Educational 
Research and Improveineni is funding itie consortium consisting of tfie University of Soutticm California, Ruigers-The Stale University of New 
Jerst^y. Harvard University. Michigan Slate University, the University of Wiscoasin at Madison, and Stanford University. The Stanford 
compoaeni, at the losUtute for Higher E<lucation Research, wUI be headed by Wilham Massy. 
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should be split into two rates--one for facilities and 
equipment (including operation, maintenance, and 
depreciation) and a second for all other components 
(including administration, library, and student serv- 
ices).^ llie academic research community is also 
hoping that 0MB will reconsider Circular A-21, 
wlUch deals with indirect cost practices.^^ 

High indirect cost rates are often seen as detrimen- 
tal to the researcher, because they increase the total 
expenditures for research grants while adding no 
additional money for research. For example, many 
Stanford University faculty are so concerned about 
a proposed increase in the indirect cost rate that they 
have pressured the university to cut administrative 
and facilities expenditures.^ 

Does the overhead rate reflect true differences 
related to the instructional capacity at universities or 
is it due to some accounting mechanism? Before 
new policies are crafted, data on actual expenditures 
should be collected and presented so they are 
amenable to comparisons across institutions. In the 
process, both universities and the Federal Govern- 
ment have much to gain in making the system more 
simple, transparent, and credible. 

Changing iixpectations and Competition 

Research expenditures increase for reasons be- 
sides the line item components of a budget. Re- 
searchers also point to higher expectations for their 
research, which require more spending and competi- 
tion in the university environment. 

Academic researchers, both young and old, are 
asked today to publish more papers, shepherd more 
graduate students, and bring in mtire Federal funding 
than their predecessors.'^ To boost research produc- 
tivity, faculty members hire postdoctorfites and 
nontenure track (nonfaculty) researchers. Graduate 
students can — and do— 4ake oyer portions of faculty 
teaching responsibility; technicians and graduate 
students can maintain equipment and run experi- 




Pholo ermUt! tMmaIfy of Michigan 

The calculation of liKltrect costs It ofton dtf f louli tMcauso of 
Inherent probtemi with Mpamtlng Instruction from 
research aclivllleson a unlveriily campus. 

ments; and postdoctorates and nonfaculty research- 
ers can advise students and assist in the operation of 
the laboratoiy.^^ All can perform research. 

For example, in the chemistry departments of both 
UofM and SU, the average number of graduate 
students per faculty averages about six to nine. Some 
professors have as many as 25 to 30. Much 
chemistry research involves long hours in laborato- 
ries, so the pace of research is brisk as well as 
necessitating the participation of a greater number of 
graduate students. Once a faculty member in a 
department or related field success in expanding 
his or her research group, others also expand their 
groups to keep pace.^' 

In this very competitive research system there is 
increasing pressure to perform more research and to 
publish more papers. Consequently, expectations 
and expenditures have risen. Perhaps one young 
faculty member at Stanford put it best: 



*^ Allocution of Aimrican Univenitiei. op. cit.. footnote 14. 

<^^See "OMO Unlikely lb Open Circulw A-21 for Ajnendment According to Indirect CoitObscrven." WathintionFax.Dtc. 12, 1990; "AAUSayi 
lUlu Continue at High Level in OMB 1b Reopen 0MB Cireulv A-21," Washington Fax, Dec. 13, 1990: and Robert M. Roieiuweig. "Hie Debate 
Over Indirect Cotti Raisei Rindaroental Policy luuet," The Chronicle of Higher Education, vol. 37, Mar. 6, 1991, p. A40. 

**Paculty argue that Stanford'i imiirect cost rate detracts from the attrvctivenesi of funding research at Stanford, i.e., they are at a competitive 
diiadvaouge. Eileen Walsh and Karen Bartholomew, •■Indirect Coiti Subject of Hme Separate Reviewi." Campus Report, Sept. 12, 1990, pp. 1. 6. 

*^i is especially true in entrepreneurial research areas such u biotechnology. See Henry Etzkowitz, ' ' Entrepreneurial Scieniistt and Entreproeurijil 
Universities in American Academic Science," Minerva, vol. 21, Nos. 2-3, summer-autumn 1983, pp. 198-233. 

"See Sidney Pcikowitz, "Larger Machines Are Breeding Larger Research "ftams." The Scientist. Oct. 16, 1989. pp. 13. 15. 
^iThis iicnd emerged from OTA interviews at Stanford University and the University of Michigan, July-August 1990. 
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Each year, we have to write more papers and bring 
in more money than many of the senior professors 
ever produced in any year of their careers. When we 
were hired as assistant professors, we already had to 
have published five or ten papen, again more than 
any of them had to do. And, it keeps getting worse.^^ 

Whether the premium on productivity defmed by 
number of papers published Is attenuating their 
quality is unclear. Bibliometric data, which provide 
a measure of use through citations, indicate that 
about 15 percent of all U.S. scientific papers are 
never cited.'^^ Publishing requires research; doing 
more research requires spending more money. Thus, 
research expenditures are not just a cost issue, but a 
spending issue as ivell. 

Relative Deprivation 

When there is such pressure to compete, standards 
become whatever it takes to make it.'' Most 
professors understand how much money and how 
many graduate students they will need to help them 
produce enough papers to get tenure, promotions 
beyond tenure, and recognition in their field. Many 
hope to do more. 

However, if they do not meet these expectations, 
some report a sense of failure.''^ Failing to meet 
self-imposed expectations only intensifies these 
feelings. This is true even if the economy of work 
has changec* such that standards of productivity need 
to be revised, or if they have succeeded but not by as 
much or as quickly as they had hoped. Social 
scientists call this situation "relative deprivation.** 



Researchers, especially on campuses such as the 
University of Michigan or Stanford University, 
cannot be said to be ''absolutely*' deprived. They 
are able to acquire laboratory space, graduate 
students, and research monies; they produce very 
significant amounts of research; and the success 
rates for proposals at UofM and SU run at least twice 
if not three times the national average (roughly two 
out of three proposals are awarded funds, averaged 
over these two universities). 

Nevertheless, the professors at UofM and SU have 
grown accustomed over the last 20 years to produc- 
ing more graduate students, more publications, and 
funding for perhaps four of every five proposals they 
submit.*'^ The adjustment to comparatively less has 
been difficult. Relative deprivation is real, but so is 
the greater sophistication of instruments, complex- 
ity of experiments, and amount of research that can 
be completed in a short time. There is also a trend 
toward an ''industrial model,** where project teams 
are larger and responsibilities are more distinct 
within Uie group.''^ Research institutions are keyed 
to hastening and demonstrating research productivity. 

Some experiments have been attempted on U.S. 
campuses to temper the drive for more research 
output. For example, at Harvard Medical School, 
faculty are allowed to list only five publications for 
consideration at tenure, with similar numbers set for 
other promotions. Thus, the quality and importance 
of the candidate's selected set of papers is stressed, 



^20TA interviews tl Sumford Uoiverf iiy. August 1990. 

^^Tbis was origiiuUly reported ts nearly one-half going uncited. See David F. Hamilton, "Publishing By— and For?*— the Urmben," Science, vol. 
230. Dec. 7, 1990. pp. 133M 332; tod David P. Hamilton. ''Research Papen: Who's Uncitcd SowV Science, vol. 251. Jan. 4. 1991. p. 25. The dau 
source, the Institute for Scientific Infonnalion, repoiu that the original estlniate included notes, editorials, and meetiog absHtcts. When scieotific articles 
alone are considered, uncitedneu by 19S8 of articles published in 1984 drops lo 22 percent. For U.S. autbon, the proportion is even lower (14.7 petceol). 
one*half that for non*U.S. autbon. See David A. Pendkbury. **Science. Ciutioo, and Funding.** letter. Science, vol. 25 1. Mar. 22, 1991. pp. 1410-141 1. 
Journals, however, appear to have increasingly tssumed a more archival function of bestowing credit than of informatloo exchange. Citation rates, 
however, are known to vary widely by neld. This may reflect more on the ways researchers credii ooe another through MbUographic references than 
on how they actually use that work. See Derek de SoUa Price, **Ciut!on Measures of Hard Science. Soft Science. Ibcfanology and Nonscicnce,** 
Communication Among Scitntists and Engineers, C. Nelson and D. Pollock (eds.) (Lexington, MA: D.C. Heath, 1970), pp 3-22. 

''^Science: The End of the Frontierl op. cit.. footnote 4. 

'H)TA interviews, i>p. cit.. footnote 71. 

^^Elscwherc this has been called the * 'industrialization" of science, or *'. . . j new coUecriviifd form in which characteristics of both the academic 
and iodustrialiased modes are intenningled. ' * See John Ziman, An Introduction to Science Studies (Cambridge. Fjs^gland: Cambridge Univenity Press. 
1984). p. 132. The dimensions of collectivized science, according to Ziman, inchide costly research appmtus, iDcreasing aggregatioo of research 
facilities, and coUaboratioo in research performance thai rtdeflnes **leamwork." In the words of the National Science Board, **. . . modem Kience and 
engineering research is more organized, capital intensive, multidisclplinary. and cooperative than in the past. Our univenities must adapt to this need.** 
National Science Foundation, * *Tbe Sute of U.S. Science and Engineering. * * A Vie w From the National Science Board, statement accompanying Science 
A Engineering Indicators— i 989, Febniary 1990. These dimensions are discussed further in ch. 7. 
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though measuring these characteristics, bibliomet- 
lics notwithitanding, remains contentious.^^ 

Strong incentives militate against reducing re- 
search ouQ>ut. For instance, since most overhead is 
brought into Uie university by a small number of 
research professors (at Stanford, 5 percent of the 
faculty bring in over one-half of the indirect cost 
dollars''^), proposals to reduce research output are 
not looked on with favor by many university 
administrations. .\ny measure Uiat would curb the 
productivity of these professors would deprive the 
university of revenues. Thus, many universities try 
to maximize the level of research volume and 
output.'' 

OTA fmds that research personnel at the two 
universities examined are experiencing relative dep- 
rivation, 'ihis would appear to be symptomatic of 
pressures felt on similar high-caliber research cam- 
puses. If so, then the Federal Government, by 
sending clear signals about the importance of 
scientific merit, education, and equity in allocation 
decisions, could aid universities in planning for a 
changing research economy (see box 6-E). 

Responsiveness 

Another factor leading to perceived instability in 
the research environment is the difference in time 
scales between changing national needs, on the one 
hand, and universities' capacity to respond to them, 
on the other. Tb build a research infrastructure, Uke 
any government contractor, universities must com- 
mit funds to construct facilities and to purchase 
equipment. If the Federal Government then decides 
to switch emphases, universities must continue to 
maintain this infrastructure. Also, no matter how 
resourceful one may be, there are few incentives for 



a professor to change research areas after having 
accumulated knowledge in one or two specialties.^ 
It is perceived as being more cost-effective for the 
university to hire new younger faculty and build up 
their research capacity than to try to convert an older 
researcher to a new field. Consequently, researchers 
in universities have little recourse if research empha- 
ses shift dramatically in Federal support for their 
particular field.^' 

An example of a growing department at the 
University of Michigan may help illustrate some of 
these points. In 1980-81, the Electrical Engineering 
and Computer Science (EECS) Department was 
perceived as weak. The central administration at 
UofM decided to invest resources in the department 
and pursue expansion. Most importantly, it decided 
on a few key research priorities: optics, solid state 
electronics, robotics, and microelectronics. The 
administration encouraged retirement of many of the 
older faculty and "weeded out" a few others. It 
hired faculty in the designated areas to fill the vacant 
slots and aidded a few faculty positions as well. 
EECS expanded its research capacity in areas that 
the Federal Government presently supports. It has 
subsequently received more Federal funding. Unfor- 
tunately, EEwS does not project, for the foreseeable 
future, the fltxibility it experienced in the 1980s. 
The department attributes its flexibility to the hiring 
of new faculty, and doubts that this flexibility will 
continue as the faculty ages. 

The development of EECS may be unique among 
university departments. As a survival tactic, univer- 
sities have traditionally attempted to maintain broad 
departments, covering many subdisciplines, so that 
if funding in one area diminishes it has a minimal 



"See N.L. OeUer et ' 'Lifetime ClUtlon Rates to Compare ScietuiiU' Work," Social Science Reuarch, vol. 7, 1978, pp. 343-363; and A.L. Potter 
et al.. "Clutloiu and Scientific Progrew: Comparing Bibliometric Ww^ei With Scientiit Judgmentt." Scienioitutrics, vol. 13. 1988. pp. 103-124. 
The National Science Foundation now llmiu the numbci uf publications it will coniidcr. as evidence of an applicant'i track record, in reviewing grant 
prc^iali. See Hamilton, op. dl.. footnote 73. 

^Rick Biedenweg and Dana Shelley. jgSdS? Decanal M .recr Coir Study (Stanford, CA; Stanford Unlvenity, February 1988), p. xii. 

"For example. Donald Kennedy, president of Stanford Univertity (SU). lald in an OTA interview (Aug. 2, 1990) that if the 1990« do not promiK 
great increase* in the Federal science budgeu. SU will have to institute four mens to balance iu budget, and the fbtt three have already been introduced: 
1) restructure the budget for SU and instigate cuU; 2) boost the research volume to bring in more research dollars; 3) lobby for increased faciUties 
programs from the Federal Ooverament: and 4) move some indirect co*u to the direct cost lines to ensure hiii recovery. 

*cSee John Ziman. Knowing Everything About NotMnt : Specialltation and Change In Scientific Careen (Cambridge. England: Cambridge Unlvenity 
Press, 1 987); and John Ziman. " 'Research u a Career,' ' The Research Sytttm in Tramition, l».E, Cozzens el al. (eds.) (Dordrecht, Holland: Kluwer, 1 990), 
n>- 345-339. "The buildup of accumuUied lUUs and knowledge puts a lot of inertia \m the academic research system, and ... a premium on expansioo 
as the easiest route toward reorienution of priorities. ' ' Harvey Brooks, Harvvd Unlvenity, personal communication, I^bruaiy 1 99 1 . 

* >In the case of a national research mission, such as the War on Cancer, relabeling one 's research to qualify for mission money was a workable strategy. 
See KB. Studer and D.E. Cbubin, The Cancer Miuion: Social Contexts of Biomedical Research (Beverly Hills, CA; Sage, 1980), especially cb. 3. 
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Box 6-E*-«Emulating the Research University: Beware 

In the last few decades, many univenities have aspired to emulate the top research univenitiest in the hopes 
of gaining a larger share of the F^sderal research pie* However* in the 1990s, the model of a research university may 
become less aniactive, functional^ and reproducible. 

Research univenities are characterized by strength across departments and other units where research is 
petformed. For instance, Stanford University is not lotown particularly for strength in one field, or even several, but 
for acn)ss*the«board excellence in every discipline—within science and engineering and without. Similarly, these 
universities are the majoi recipients of Federal research and development funds and train the largest cadre of new 
Ph.D.8 in those disciplines.^ 

Outside the top 50 to 100 institutions are hundreds of universities that also compete for Federal research 
funding.^ They reason that an influx of Federal monies could ease some of the financial burdens they face, but 
moreover, could boost their capacity to do research and attract still more ftinding from other sources. Aiguably , the 
research imiv^sity has bem a model for emulation even for institutions whose missions and resource base made 
them unlikely candidates to join the top 100. Institutional mobility is rare, but does occur. 

Unfortunately, beneath the surface of many successful research universities lie many fiscal problems connected 
with their research enterprise: 

1. The demand for research funding is rising in some fields faster than fiunding available from Federal and 
other sources, and some univmities claim th^ cannot keep up. 

2. Demands for state-of-the-art facilities are increasing with little financial help from the Federal Government, 
so universities must tap State or private coffers to allow for renovation and new construction. 

3. Charges abound that research faculty are shirking their teaching commitments, and students complain that 
their education has suffered. 

These problems notwithstanding, there is still an allure-Hind a necessity~4o pursue Federal research dollars. 
In addition to competing quite successfully for disciplinary agency support, universities are attracted by Federal 
initiatives that ef\joy **new" priority funding. At the University of Michigan, fw example, initiatives such as global 



>In flical yt$i 198S, 10 univenities received simoit oae«quarter of the Federal itsetrch and development (bads swtrded to all aouietnlc 
insiitutlofli. They were Joboi Hopidai, Stanford. Maisacfauieitt Institute of Itehnology. WiicoQsin-Madlioci, Mlcbigan, Washiqgtoa, 
Califomia-Saii Diego, Cornell, Califomia-Los Aogelei, and Cotuabia. See National Science Fouodatioo« Academic SeUnci andBnginHrtngi 
RAD Fumt$^i3C0t Year 1988.fiSP%9^n6(W$Mn$iotutX: 1990). tabteB»37.11ieiesaiiie 10 ualvertitks produced IS pocenl of aU science 
and engineering PhJ)j. (3,303 of 20,738) thai year. National Science Foundation. ScUnct(mdBngin€tringDoetofM$: 1960*89, NSP 9O>320 
(WashlngtoQ, DC: 1990). table 9. The dliiributioo of booors. e.g., Nobel prizes and election to the National Academy of Sciences, reinforces 
the itratificatioo among research univenities and Uie role of a select few in the education and employment of U.S. scsentlits. 

2For example, 1,719 institutions were fupp<med by the National Institutes of Health (NIH) in 1990, but only 25 accounted for 38 percent 
of NIH'i extramunl fundi. See **NIH Policy Change Could Shake Up Distribudon of NIH Extnumiral Rmdingi Official Says/' Washington 
Fax. Nov. 23. 1990. 



effect on the depiytniciit as a whole. On the other 
fuind, if one area receives increased support, the 
university will be prepared to lake adviUiiage. Due to 
increased conipelilion for funds, the ino<lel of a 
multifaceted yet targeted depiirtment. such as EECwS, 
may become more prevalent. Universities may find 
that concentrating their research capabilities in 
specific areas may enhiuice their competitiveness for 
Federal funding by augmenting their rescitrch track 
record and the availability of reseiwch facilities and 
equipment in those areas. Another tactic is the 
welcoming of non-Federal .sources of research 
funding to campus, often to 'Meverage" Federal 
funding (see bt)X 6-F). 



In the current research economy, a broad base is 
increasingly difficult to maintain. Universities try- 
ing to achieve the status of the top 50 research 
institutions are bound to face numerous obstacles if 
they try to obtain — and sustain — success through a 
broad -based approach. 

Summary 

In this chapter, OTA has reviewed data on 
reseiu-ch expenditures from the perspectives of both 
the Federal Government iind academic research 
performers. Fueled by increases in Federal, indus- 
trial, and academic spending on research, the na- 
tional research effort and the levels of basic and 
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cUmate change and the Human Genome ftoject are seen as ''bandwagons**: once the univenity commits resources 
to participate, it nins the risk of absoibing the coMs of the research ihfrastiucture and persoimel afto* Federal support 
wanes.^ 

If the top research universities are struggling to maintain excellence, even widi their inherent advantages, it 
may be unwise for other universities to try to become like tfiem. It takes years to develop the breadth and dq^ of 
resources that makes a research universi^; it does not happen quicldy^^ Moreover, the classic research university 
model may simply be maladi^ve for these times*' Maintaining the human and physical infiastnicture that has 
accumulated over decades is a huge financial burden that affects all campus functions.^ 

Building targeted strength would appear to be a more sensible institutional strategy than striving for 
across-the-board excellence. Thus* one magnet labmitoiy ftmded by the National Science Foundation (and the State 
of Florida) will not transform Florida State University into a Massachusetts Institute of Ibchnology. But Florida 
State might become world-class in research on high-energy magnetism. Such taigeting demands concentrated fiscal 
and human resources, selective recruitment of fsculty researchers, and constiuction of facilities. The Federal 
Oovemment has a role to play in this effort. As recently stated: '*It*s the classic American challenge: What*s the 
best tradeoff between the conflicting desires of preserving excellmce and promoting diversity?**^ 

Preserving excellence in research and teaching at U.S. researching universities is not a Federal obligation: it 
is a good investment. Research imiversities have strategic plans, critical masses of researcherSf and the reputation 
for selectivity. However, those institutions that aspire to join the select group of top research universities in the 
1990s might best reconsider the research university model«-^d proceiMl at their own risk. 



^Id the ihon nm, resources tfaii would have beco devoted to Initructioo teod to set diverted to Uils m^^irofUe researcb. Inveitiig in 
fishiooable research is an importAiit part of tbe university portfolio^ but Uie cost of some activities may have an adverse effect on others This 
example is based on OTA interviews with University of Michigan administnuon, July 1990. 

^s wu a recurrent theme at bearings held by the House Committee on Science and Ibchnology, Tuk Force on Science Policy tn 
19SS«86. For an analysis of members' and witnesses* concerns, see Patrick Hamlstt, **Tuk Force on Science Policy: A Window on the FMoal 
Funding and Management of Research.*' 0X\ contractor t^ion. October 1990. Available through the National Ibchnical lofonnatioa Service, 
see app. F. 

^See Linda B. INtfker and David I.. Clarkt ^'D^aitmental Responses to Fluctuation tn Research Resources." Resweh Mwagtmnt 
Review, vol. 4, ^riog 1990, pp. 19-34. 

^haps die roost striking evidence of a university's ttseardi Intonsiveness is the number of postdoctoratM it employs. By tUs measure, 
Stanford and Michigan are spectacular examples. At botfi institutions, postdoctorates fai life sciences rqmaent two to tb^ times the nunber 
of postdoctoral appointeea in all other fields combbied. (Physical sciences is the nmner^up on both campuses.) At Staofcdi die number of life 
sciences postdoctorates doubted to 600 in I9S8. TUs also represeou almost twice ibe number of graduate (i.e.| predociond) studenu in life 
sciences at Stanford. At Michigan the emphasis is reversed: although postdoctorates in Ufe sciences grew firom 160 to 2S0 between 1980 and 
1988, the nunri)er of predoctond students to dwse fields totaled three times 
postdoctoral numbers are probably refle^ed in die cm^Msition of research teams. 

^Michael Schrsge, "Bturring the Line Between Funding Science and nmdiag Economic Growth.* ' The Washington Post. Oct. S, 1990. 

p. F3. 



applied resciirch individually iire at levels surpiissing 
the *• golden age" of the 1960s. However, the rise in 
demand for funds from the research community 
continues to outpace Federal funding increases. 

Tliis rise in denuuid is due prinwily to increased 
spending on reseiirch, iuid only secondarily to 
increases in the •'costs" of individual components 
of research budgets. Increased spending appears to 
stem from the growth of the size of research groups 
under the direction of one principal investigator, a 
tendency toward growing pressure to produce more 
research, and an increasing complexity of equipment 
iuid facilities (although advances in technology can 
also decrease overall spending). 
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Reliable analyses of research expenditures by 
Federal agencies are not available. Information 
provided to the agencies by the performers is likely 
to combine actual need with the desire to pursue 
boundless opportunities in research. Some trends, 
however, are well documented. The number of 
scientists conducting research and supporting gradu- 
ate tmd postdoctoral students has grown. Every 
agency has seen a growth in the number of griuit 
applications submitted. In addition, average expend- 
itures per investigator have nearly tripled, in real 
tenns. since 1958. The obsolescence time for 
equipment and instrumentation has shrunk more 
than twofold, iUid facilities built in the 1950s mid 
1960s are in need of repair and renovation. The 
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Box 6-F^industry on Cani^us 

Universities have been aggitssive in seddng indusby nipport for leseaich in the 19808, though the relationihip 
betweo) the two sectbri hai been i 'Hwo-wty street** fc»* mm than a half^centiliyJ Indusoy fotidihg of univerfei^ 
research/ though brisk in the 19808, stilt lepitsehted just bv« 5 percent of all university lesMrdi. (The highest 
proportions are ftmnd at engineering institutions— Georgia Institute of Ibdmology, Camegie^Mellont Massachu- 
setts Institute of Ifechnology.) Most of that ftinding was geared to generic, nonproi^ietaiy knowledge aided by 
support for faculty, graduate sftidents, and infirastnicture. In other words, technology transfer, patenting, and 
commercial gain were not the primary motivations for academfc-industiy relations*^ 

Until recently, only certain fields have had relevance to industry investment for a profit motive: computer 
science, meudlurgy, materials science, and chemistfy More recently, biology has offered industiy new techniques 
for the development of products and pfocesses. As historian Roger Geiger points out: 

The esse for the importance of die university role in economic development rests on two {Hllan: that industry 
has been underinvesting in generic research, and thus could profitably utilize additional research from univenities; 
and UGond. that discoveries of potential commercial value were being made in universities, but were not reachiiv 
the maiket because of linking mechanisms.^ 

Li many fields, the demand for research funds are exceeding available funds from traditicmal sources-- 
especially in fields that require large-scale, technologically advanced equipment and instruments, as well as more 
technicians with more skills. Concerns about sponsorship— military as well as industrial— skewing the research 



^Large chemical and drug conpaiuet ftmded uflivenity laboratoriei for routine lervlcef , like testing, begionlng in the 19309. See Roger 
L. Geiger. "Industty and UnWersity Research: The RevolutlOQ of the 1980i«'* SeUtice and Technology ond the Changing World Order. 
colloquium proceedings. Apr. 12*13. 1990. S J>. Saner (ed.) (Washixigtoti, DC; American Auociation for the Advancement of Science, 1990). 
pp. 138*148; and Paul B. Gray. "Advanugeoui U$iujmrissues in Scitnci A Technology, vol. 6. No. 3. spriog 1990. pp, 4046. 

^See Roger L. Geiger. ' 'MiUdog Che Sacred Cow: Research and the Queit for Useful Koowlectge in the American Univmity Since 1 920/ ' 
Science, Technology, A Human \bluee, vol. 13. Nos. 3«4. Mmmer A autumn 1988. pp. 332*348. 

^According to Richard R. Nelson, "Institutions Siq^iting Ibchnical Advance in Industry/' American Economic Reyiew. vol. 76, May 
1986. pp. 186-189. 

^iger. op. cit.. foomole 1. p. 147. For a case in point* see David Blumenthal et al.. "University-Iodustiy Research Relationships in 
Biotechnology: Implications for the University." Science, vol 232. June 13. 1986. pp. 136M 366: U.S. CoQgresa. Office of Ifccfanology 
Assessment, US. Investment in Biotechnology, 01A-B A-360 (WsshiBgtoo« DC: U.S. Government Frintlflg Office. July 1988); and Phyllis B. 
Moses and Charles E. Hess. "Gening Biotech Into the Field/' tssuee in Science A Technology, vol. 4. No. 1. fall 1987, pp. 33*41. 



entire enterj^rise has grown at a rate above inflation 
and beyond what the cuneiit Federal budget ciui 
j^erhaps alloid. 

Competition for funds, coupled with a failure to 
meet reseiuch expectations on the part of nuuiy 
reseiu^chers. contributes to relative deprivation at 
many reseiU'ch universities. University reseiu-chers 
feel deprived because their resources (and subse- 
quent oiitf^uts) have not met their expectations. 
Although many universities urge a quick infusion of 
motley to ensure their responsiveness to national 
research missions as well as the scientific reseaich 



base, from an **exfXinditures/costs'* perspective, it 
may not be the appropriate role of the Federal 
Government simply to supply extra funds. Rather, 
the Federal Government could encourage both 
established juid aspiring research universities to 
consider the funding environment juid to adjust their 
research agendas, timetables, and needs accord- 
ingly.^^ Devising mech;uiisms for understanding 
and coping with research exfxinditures is one of the 
central challenges to the Federal system for funding 
reseiu-ch in the 1990s. 



shDuUl Iv rioicd lhai. under the Monda and l-odcral Ocniorislralioa Projecls. na-cosi cxicnsions on research ^uwws and oiher moan-; of expanding 
ihe aulhoriiy ol ujiiversmes loeonirol rouMfch bud^.ei.s Ux .illy have been successfully Icsled By providing flcxibjliiy, ihese exparuled auihoriues creule 
opponunmcs for eosi savm^as and improved atcouniahihiy See Anne Scanley and William Sellers. Oovemmenl'Umvcrsiiy'lndu.stry Research 
Roundiahlc. •Summary t>l jjikrim Kej>on.s Subiniiied bv (Iraniee Organi/anoris ParMcipaUng in Ihe f ederal DemoiLStration iVojtvl/* unpublished 
diKumeni, Oci 1. P^^X) 
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agenda and undermining the spirit of open inquiiy on campus are still voiced.'^ But the trend has not so threatened 
academic nonns as to provoke a backlash.^ Perhaps out of economic necessity, universities have accommodated.^ 

The ••competitiveness debate has legitimised academic involvement with industry, if not outright promoted 
it. There is an assumption that strengthening the links between industiy and university research will improve 
America's economic malaise. A series of legislative and executive initiatives in the 1980s encouraged collaboration, 
such as the Patent and Trademark Amendments of 1980 (Public Law 96-517), the Stevenson- Wydlcr Tfechnology 
Innovation Act of 1980 (Public Law 96-480). the 1981 Economic Recovery Tax Act (Public Law 97-34), and the 
National Qwperative Research Act of 1984 (Public I aw 98462). In addition, the 1980s witnessed a growth of State 
economic development programs that aimed to stimulate university-industry cooperation in public universities. 
More and more, linkage between universities and industry has been viewed as essential and mutually beneficial.^ 

ITie resiliency of the university v;iJl continue to be tested by rising demands for research funds and the 
proliferation of missions served by experts on campus. In the 1990s, opportunistic funding of university research 
may give way to a moderation of corporate-sponsored research. Or such undertakings may cwitinue to be physically 
segmented in a research institute or center as a way of detaching the industrial values it symbolizes from the core 
campus organization.^ The existence of university-industry collaborations is not in doubt; the forms of these 
collaborations, however, will remain in flux. 



^hot example, sec *'Sccrccy in Univcrsiiy-Bascd Research: Wlio Conlrols? Who Tills? *\9n>ncc. Technolofiy. & Human Wues, special 
issue, vol. 10. No. 2, spring 1985, pp. 3-114; and Henry El7Jcowirz. '*Thc Second Academic Revoluiion: The Role of the Research Univcrsiiy 
in liconomic Dcvclopnienl.** The Research System in Transition. S.E. Cozzeas et al. (cds.) (Dordrecht, Holland: Kluwer. 1990). pp. 109- 1 24. 

^li has nuide *'inielleciual property" an academic as well a.": a Federal policy issue. For discussioas. see Marcel C. LaFoIlette. **U.S. Policy 
on Intcllcclual Property in R&D: emerging Polilical and Moral Issues." in S.E. Cowms el al.. op. cir. foomole 5. pp. 125-139; and U.S. 
Congress. Office of Tfechnology Assessmenl, inteiiectual Property fiights in an Af^e of Electronics and Information, OlA-CIT-302 (Springfield. 
VA: National Tbchnical Infommlion Service. 1986). Also see Charles Weincr, ''Universities, Professors, and Palenis: A Coniinuing 
Controversy." Technology Review, vol. 89. No. 2. February/March 1986. pp. 33-43. 

'For example, see George R. McDowell, "Land-Grant Colleges of Agriculture: Renegotiating or Abatidoning a Social Conlraci/* 
Choices, second quarter 1988. pp. 18-21 

*^Omce of Ifechnology Assessmcni. op. cit . foomtile 4. Also sec Barry Rozeman and Michael Crow. "'Hie Euvironmenis of U.S. R&D 
Uboralorics: Polilical and Market Influences." Policy Sciences, vol. 23. No. 1. 1990. pp. 25-56. 

^Sce I^orothy Nclkin and Richard Nelson. "Conuncnlaty: Univcrsily-Industry Alliances." Science, Technology, A Human Values, vol. 
12, winter 1987. pp 65-74. In otiier words, the value of academic research is likely lo persisl. if nol grow. Sec F^ward M. Scolnick. "Basic 
Rcsc;i/ch and li.s In»paci on Indusirial R&D," Research-Technology Management. November-December 1990. pp. 21-26. 
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CHAPTER 7 

Human Resources for the Research Work Force 



My first priority is tc create an environment in which talented young people choose 

careers in health sciences research My second priority would be to fashion a system 

in which talented, more senior researchers could obtain stable fitnding for their best 
work. Those two priorities cannot be achieved without setting some limits and making 
difficult choices. 

Leon Rosenberg' 



Introduction 

The scientific education system in the United 
States, especially at the doctoral level, is the envy of 
the world. Foreign nationals continue to seek 
degrees in science and engineering at U.S. institu- 
tions at an ever growing rate, and this exemplary 
"production" of Ph.D.s has continued over at least 
the past 30 years. 

The U.S. graduate research and education system 
trains new researchers and skilled personnel for all 
sectors of the Nation's work force (and for some 
countries abroad). Wiile new researchers have 
traditionally been trained for faculty positions in 
academia, in fields like computer science, the 
demand for technical labor outside of academia is 
great. Some fields, like chemistry, also benefit from 
having a large set of potential academic and indus- 
trial employment opportunities. This diversity 
makes any labor market fluid and its forecasting 
difficult, but the major components can be analyzed. 

This chapter focuses on Ph.D. production and 
employment in the United States and the research 
work force, as a subset of the total science and 
engineering work force. The educational "pipeline" 
that prepares students at the K-12 through under- 
graduate level for doctoral study is dis<:ussed where 
needed.^ First, the chapter discusses the overall 
shape of Ph.D. production in the United Stales, the 
Federal role in supporting graduate education, and 
the present employment prospects for new Ph.D.s. 
Second, the chapter focuses on projections for future 
employment of Ph.D.s, and then turns to training 




Ptotocftdli: U.S. DtpartrntfitofEnvgy 



Scientist mixes a diemlcal sample. Broadening the 
participation In research of traditionally under- 
represented groups, such as U.S, minorities, Is a central 
issue for the health of the research enterprise. 

considerations for an uncertain fxiture. The chapter 
concludes with a discussion of the Federal role in 
Ph.D. production and employment for the 1990s. 

Baseline Data on Science and 
Engineering Degrees 

Trends in the award of science and engineering 
(s/e) degrees highl'ght 20 years of growth in human 



'Quoted in Dick Thompson, "The Growing Crisii in Medical Science." Time. Dec. 17, 1990, p. 21. 

*An analysis of jhc higher education sugcs of the pipeline aiul how the Federal Govertiment intersect with it ,s contained in U.S. Congress. Offux 
of Itehnology Assessment. Hinfier Education for .Science and Engineering, OTA-BP-SET 52 (Washington. DC: U.S. Government PrinUng Office. 
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fesources.3 Scientific education has yielded a signif- 
icant number of new Ph.D.8, yet the benefits of this 
education have not accni&d equally to all groups and, 
therefore, to the Nation. Women and U.S. racial and 
ethnic minorities, despite gains in Ph.D. awards 
through the 1970s and 1980s, lag the achievement of 
white men. Relative to their numbers in both the 
general and the undergraduate populations, women 
and minorities are underparticipating in the research 
work force.^ Foreign nationals on temporary visas 
are a growing proportion of s/e degree recipients.^ 
National Science Foundation (NSF) data indicate 
the following trends.® 

Degrees, Gender, Ethnicity, Nationality, and 
Fields of Study 

The total number of Ph.D.s awarded in s/e has 
increased from 17,400 in 1977 to over 20,250 in 
1988. In addition, the proportion of s/e Ph.D.s 
awarded as compared with Ph.D.s granted in all 
fields varied from 57 to 64 percent over the period 
from 1966 to 1988 (see figure 7-1). 

Of the approximately 34,000 Ph.D.s awarded in 
1988 (in all s/e and non-s/e fields), the disoibution 
by sle field ranges from 2 percent in environmental 
sciences to 15 percent in biological/agriculniral 
(hereafter, "life") sciences. Trends in field shares 
are variable, showing percentage increases and 
decreases over the period 1966 to 1988 (see figure 
7-2). 

One in three college graduates earns the baccalau- 
reate degree In an s/e field. By gender, men earn 
more baccalaureate degrees in s/e fields per thou- 
sand than women by a ratio of three to two.' In 1988, 
women earned 40 percent of baccalaureate degrees, 
30 percent of master's degrees, and 27 percent of the 



Figura 7-l-4>h.0.i Gnntad, by Field: 1966-88 
Ptreentase of all FM>.t granted 




1966 



1971 



1976 



1981 



1986 



Science/engineering CD Nonselence/«nglneerlng 

SOURCE: National Sdanc* Foundation, So/anoa and &)gtn»tting Da* 
grtm: 1966^. A Sourca BeoK NSF 90-312 (WaaMngton, DC: 
19W), tal}(a 1 ; and National Seianoa Foundation, SeltnMMnd 
Engkmrfng Ooetermn: 1M049, NSf OO-UO (Waahlngton, 
OC: 1 0M), labia 1 . National Sdanoa Foundation, SdiK* and 
Enghmring CharMt: 1969-99, A Soutv Book NSF •O'Sia 
(WMilngton, CIC: 1090), tabia 1 ; and Natbnal Sdanca Founda- 
tion, Sei»nea and engln—ring Dodorataa: 196049, NSF 
90-320 (Washington, DC: 1990), tabia 1 . 

doctorates awarded in s/e. At the Ph.D. level, this 
proportion represents more than a tripling since 
1966 (see figure 7-3). (In non-s/e fields, however, 
women have achieved parity in Ph.D.s earned and 
exceed the numbers of men awarded baccalaureate 
and master's degrees.) 

Except for life sciences, psychology, and social 
sciences, the number of doctorates awarded to 
women is modest. In 1988, among U.S. citizens, 
men earned 90 percent of the engineering Ph.D.s, 63 
percent of the science Ph.D.s, and 48 percent of the 
non-s/e Ph.D.s. In fractional terms, women now earn 
one in three life sciences and social sciences Ph.D.s 
and more than one of every two Ph.D.s awarded in 
psychology. From 1966 production rates, engineer- 



Ultbough OTA uui tbe ihorttund "tciemUii and engineen," it recognlzei tiw divenity of fleldi repreMnted by Ibe tenn. These rtelds are tho*« 
used u degree-granting categories in the Natiooai Science Foundation's Science Resources Studies reporU: eogioeeriog, physical scieoccs. 
cuviroomental sciences, roalhemstical Klences. compuler/iaformatioo sciences, life (bioiogical^M(ricultural) sciences, psychology, and social sciences. 

^Def^ees akme tell an incomplete story of funire supply of icientisu and engineen . For example, coUqie attendance rates of 1 8- to 2 1 -year-oldi vvy 
tiy gender and me. Since 1972, 3S to 40 percent of whiles of both sexes in the cohort have attended college with Black rates in the 2S to 30 percent 
lange. By 1988, female attendance exceeded that of males and was rising, whereas male attendance of both races peaked in 1986-87 and hu declined 
thereafter. See National Science Board, Science & EngineeriHg lndicaton—1989 (Washington. DC: U.S. Oovemmem Printing Office. 1989). figure 
2-2, p. 50. The National Science Foundation furnishes all data reported in the Science & Entineeiing Indicmrt report. 

'For an overview, see Commission on Profeuionals in Science and Itehnology, Measuring National Needs for Scientists to the Year 2000, report 
of « workshop. Nov. 30-Dec. I, 1988 (Washington, DC: July 1989), pp. 20-24. For more on paduaie engineering education, see Gliiior Barber et al.. 
Choosing Futures: U.S. and Foreign Student Views of Graduate Engineering Education (New York, NY: Initimie of Iniematiooal Education, 1990). 

•National Science VoaaiMAoTuScience andEngintering Degrees: l966-l98i~A Source Book, NSF 90-312 (Washington, DC: 1990). Doctorate dau 
are drawn from the multiple agency-sponsored Survey of Earned Doctorates conducted under contract the National Research Council and assembled 
and reported by the Division of Science Resources Smdles of the National Science Foundation. 

^This riitio has narrowed since 1966 when it was nearly 3 5 to 1. See ibid., ubte 53, p. 43. Also see Saiah B. Huner and William O. Bowen, "The 
Flight From Arts and Sciences: Trends in Degrees Confcned." Science, vol. 250. Oct. 26, 1990. pp. 5 17-521. 
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Figura 7-2— Distribution of Doctoratot by Seieneo 
•nd Englnotring Fiold, 1960-90 
(by(l«eKit.in pcretnt) 
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oomputcr tdcno* wn counted with malhtnwtical $ei«noM. 
SOURCE: National Sclanoa Foundation, S<^nM»ndEngin—ring Doctor- 
IWhti, NSF 90-320 (Wuhington. DC: 1000), tabl« 1. 



Figurs 7-3— Sctsnes and Englnotring Dtgrsss, by 
Lsvsl and 8«x: 1066-88 
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ing increased from virtually no awards to women to 
almost 7 percent in 1988, while physical sciences 
experienced a fourfold increase to 17 percent.^ 

The total number of Ph.D.s in s/e awarded to 
minorities rose from 560 in 1975 to 1,100 in 1988. 
However, trends by ethnic group are not as consist- 
ent. Black U.S. citizens earned 240 Ph.D.s in 1975, 
which rose to a high of 290 in 1979, but by 1988 had 
dropped to 230. Degrees awarded to Hispanics over 
the same period increased from 130 in 1975 to 320 
in 1988, exhibiting predominantly steady increases 
each year. The most dramatic increase occurred 
within the Asian population, which recorded in- 
creases from 190 Ph.D.s in s/c in 1975 to 440 Ph.D.s 
in 1988, with gains posted in every year but one 
(1985).' 



'N«ttOQiJ Science Board, op. clt.. foomote 4. ubtes 23 and 25» pp 25-26. 
^bid., pp. 55-56, TTic uumberi hive be«n rounded. 



Doctorates 




SOURCE: NallontI Sdenc# Foundation, Scim:^ Mi £ngin00i1ng D#- 
1966 6$, A Source BooK NSF 90-312 (Wsihingtod, DC: 
1990). tiibl##3and 4. 
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Foreign citizens on temporary visas earn increas- 
ing piopoftions of the s/e doctorates awarded by U.S. 
universities: one-quarter of all s/e Ph.D.s, and as 
much as 40 percent in engineering and mathemat- 
ics.'°The number of Ph.D.s awarded in s/e to foreign 
citizens on temporary visas increased from 2,700 in 
1975 to 4,800 in 1988, with the most rapid gains in 
the 1980s. Foreign nationals on permanent visas, on 
the other hand, decreased from 1,200 in 1975 to 820 
in 1984, but experienced a rapid rise to 1,100 in 
1988. At the same time, the total for U.S. citizens 
dropped from 14,000 in 1975 to 12,800 in 1988, with 
the most rapid decrease in the late 1970s. During the 
1980s, s/e Ph.D.s awarded to U.S. citizens showed 
no clear trends, ranging from a low of 12,600 (1987) 
toahighof 13,300(1981).'» 

In summary, the total number of Ph.D.s awarded 
in s/e in the United States has increased by nearly 50 
percent from 1977 to 1988. Hie numbers of women 
and minority recipients of Ph.D.s have also in- 
creased, with the greatest gains posted by women, 
Hispanics, and Asians, but with no gain by Blacks. 
Perhaps most dramatic is the increase in Ph.D. 
awards to foreign citizens on temporary visas, which 
almost doubled from 1978 to 1988. (For a compari- 
son of national trends with the experiences of four 
research universities — public and private, and re- 
gionally dispersed — see box 7-A.) 

Forms of Federal Support to 
Graduate Students 

Clearly, graduate enrollments and the award of 
the Ph.D. in s/e depend on more than undergraduate 
degree attainment. Institutional practices and Fed- 
eral policies play a significant role in graduate 
student support, completion of the doctorate, and 
employment aspirations. OTA notes the following 
trends. 

Ever since the National Defense Education Act of 
1958 (NDEA, Public Law 85-864) passed in tlic 



wake of the Sputnik launch, the Federal Government 
has been pivotal in pre- and postdoctoral support of 
science, engineering, and indeed, non-s/e students.*^ 
Additional programs were soon established by NSP, 
the National Aeronautics and Space Administration 
(NASA), the National Institutes of Health (NIH), 
and other Federal agencies. This period of growth, 
beginning in the 1960s, in Federal programs offering 
fellowships (portabte grants awarded directly to 
students for graduate study) and traineeships (grants 
awarded to instimtions to build training capacity) 
was followed by decreases in the 1970s.*3 In the 
natural sciences, these declines were offset by the 
rise in the number of research assistantships (RAs) 
awarded on Federal research grants. Federal support 
to the humanities and social sciences has always 
been comparatively less since, outside of NDEA, 
traineeships and fellowships were offered for the 
natural sciences, and research assistantships are 
rarely supported on social sciences or humanities 
grants. During the 1980s, other sources of support, 
including loans and family contributions, remained 
constant (see figure 74). 

In the 1980s, RAs became the principal mecha- 
nism of graduate smdent support, increasing at 5 
percent per year since 1980 (except in agriculniral 
sciences, where RAs have actually declined). This 
trend is consistent with the growing '^research 
intensiveness" of the Nation's universities: more 
faculty report research as their primary or secondary 
work activity, an estimated total in 1988 of 155,000 
in academic settings.*^ 

If the Federal agencies were to change die mix of 
support to graduate sUidents, first by increasing the 
number of portable fellowships, the concentration of 
support in the major research universities would be 
reinforced. On the other hand, if die government 
were to increase the number of traineeships, Federal 
support could be directed to a broader set of 
institutions. No particular mix of support mecha- 



«"Ibid.. pp. 46. 36. 

1 >Nole thai the numbers of Ph.D.i awarded to U.S. citizens and to foreign citizens on temporary and pemument visas do not add up to the number 
given for all Ph.D.s awarded. Roughly 7 percent of the toul number of Pb.D.s are of unknown citizenship. Lawrence Burton, Science Resources Smdies, 
National Science Foundation, personal conununicatioa, Dec. 10. 1990. 

i^For details, see U.S. Congress. Office of Ibchnology Assessment, Demographic Trends and the Scientific and Engineering Work Force, 
OTA-TM-SET.35 (SpringflcP. VA: National Tfechnical Infonmtion Service, December 1985). pp. AA-A9. 

'JAisociation of Americw Univenilici. Tht Ph D. Shortage: The Fedtral Role (Washington, DC; Jan. 1 1. 1990), pp. 15-16. 

"These 135.000 reprewnt 37 percent of employed t b.D. scientisU and engineers In the United States in 1987. There are several assumptions built 
into these eciimate^— that Ph.D.s are most likely to do research, that research is considered a "primary or secondary research activity" by survey 
respondents, and thai (although RAD are coupled here) basic and applied "R," not "D" is performed in academic settings. National Sclace Board, 
op. cil.. footnote 4, pp. 46, 57. 1 13. 
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(bytypa of support) 

In ptrotnt 



-fellowships 
-Trslnesshlps 




Research 
asslstantshlp 



Teaching 
asslstantshlp 

Other support 



100 



ao 



60 



40 



20 



Tot.1 
etudsnts 

supportedi 61,620 



1966 

64.652 



NOTE; F«llowihipt and traln«Mhlp» w«r« not r«port«d Mparatcty in 1 669. 

SOURCE: NatloMi Sdtnc* Board, Schnc* i Englimring MMorw-^ 
1889, NSe ae-1 (Wa«Nnglon, DC; U.S. Qov*ntm«nt Printing 
OfflM, 10M), app. labia 2-1S; and National ScJanca Founda- 
tion, OnMf SMtni Support and U»npemr Rmouku in 
GrmhM* Sd^no* Eduattlon. F«# 1969. NSF 70-40 (Wuhlng- 
ton OC: Saptamlw tft70), tabia C<1 la. 

nisms appears to alter the decision to pursue 
graduate study. 

Employment of Researchers 

Since 1980, NSF estimates that the total s/e work 
force (baccalaureate, master's, and Ph.D. degree 
recipients) has grown at 7.8 percent per year, which 
is four times the annual rate of total employment of 
1.8 percent. Scientists and engineers represented 2.4 



percent of the U.S. work force in 1976 and 4.1 
percent in 1988.^^ Almost 2.0 million scientists and 
2.6 million engineers were eiiq}loyed in the s/e woik 
force in 1988. In addition, almost 25 percent of all 
scientists and 10 percent of all engineers were 
employed in non-s/e jobs in 1988. At the doctoral 
level, scientists numbered 351,000, which is five 
tiroes the engineers at 68,000. Tbtal enq}Ioyment for 
doctoral scientists and engineers grew by nearly 5 
percent per year from 1981 to 1987." The percent- 
age of foreign nationals who remain in the United 
States after receiving their Ph.D.s remained at 
roughly 50 percent Jirough the latter half of the 
1980s. 

A pivotal employment sector for Ph.D. s/e re- 
searchers is academia. F^om 1977 to 1987, the 
number of Ph.D. scientists and engineers engaged in 
academic research increased by 65 percent. Figure 
7-5 shows that life scientists accounted for one in 
three doctoral scientists and engineers on campus, a 
proportion unchanged in a decade, while figure 7-6 
indicates average annual growth rates by field, with 
computer and information scientists leading the 
way. 

The academic research work force in 1987 was 90 
percent white (both sexes) and 84 percent male. 
Overall participation in academic research by minor- 
ities is bifurcated — 9 percent is Asian and expand- 
ing, 2 percent is Black and Hispanic and barely 
inching upward. The most encouraging statistics are 
for Black women who, in 1987, represented 31 
percent of Black Ph.D. scientists doing research in 
the academic sector. 

NSF estimates a 51 -percent increase, from 1977 
to 1987, in the number of s/e doctorates engaged in 
basic research, regardless of employment sector. 
Four out of five (79 percent) worked in academia in 
1987 (see figure 7-7); industry employs 8.6 percent; 
the Federal Government employs 6.7 percent; non- 
profit institutions support 3.5 percent; and other 
groups employ the fmal 2.6 percent. 



'*U.S. Congress, Offke of Tkchnotosy AsKSiroeot, Educating Scientitis and Engineers: Grade School to Grad School, OTA-SET-377 (Washiugtoo, 
DC: U.S. Govenunent Prioting Offlco, June 1988), p. 88. The admlnUtratkm'* fucal year 1992 budget, however, proposes to consolidate graduate student 
floancial aid programs at the Deptrtiuent of Education iuto a single National Onduate Fellowships Program (NGFP) and place it under the discretiooaiy 
•uttwri^ of the Secretary of Educalioo. Included under N' IFP is the Graduate Assistance in Areas of National Need Program to suppon physical science 
snd engineering studenu ($23 mllUoo in fiscal year 1991). See "FY 1992 Budgeu for Social and Behavioral Science Reseaivb." COSSA Washinaton 
Update, vol. 10. Mar. 4, 1991 , pp. 10- ll . * 

'^National Science Board, op. cit, footnote 4. p. 67. 

i^lUd., p. 116. 
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Box 7-A— Institutional Variations on National Trends: Graduate Enrollments at 

Four Research Universities 

While national trends in graduate enroUmenu, demography, wppoit. and distribution by field paint the "big 
picture," they deperwnalize and often maslc how institutions (and their sponsors) influence those destined to join 
the research woiic force. Ftofiles of graduate student enroUmettU at four research universitie»— two public, two 
private--pR)vide comparisons among Icey characteristics.* 

In the 1980s, graduate enrollments grew by 18 percent nationally. By broad field, enrollments have, in 
percentage temis, grown steadily in engineering and mathematics/computer science, decreased slightly in die life 
sciences and more markedly in the social Miences, and been stable in psychology and the environmental sciences. 
But these national trends are not mirrored at the four universiUes examined by OIA: the University of Houston, 
the University of California-Santa Baibara (UC-Santa Barbara), Carnegie-Mellon University, and the Massachu- 
setts Institute of Ibchnology (MIT) (see table 7A-1). 

Growth in enrolbnents ftvm 1980 to 1988 range firom 43 percent at Carnegie-Mellon to 13 percental UC-Santa 
Barbara. MIT*s enrollment declined by 2 percent. The Univenity of Houston, while increasing its graduate student 
population by one-third, experienced the hugest growth in mathematics/computer science. At Camegie-Mellon, 
there was virtually no change in tlie distribution by broad field during the decade. At MTT, engineering enrolbnents 
declined (but over one-half of all graduate students there are pursuing engbiecring degrees), and at UC-Santa 
Barbara the numbo' of mathematics/computer science studems nearly tripled. 

Examined in tenns of demographic characteristics, the graduate snident populations at all four univenities 
reflect national trends, but at different levels: 

• Nationally, the proportion of women is up slightly to 32 percent. At the four universities highlighted here 
the trend is similar, but enrollments of women avenged one-quarter of all science and engineering (i/e) 
students. 

• Foreign nationals comprise ahnost one-half the graduate s/e students at Houston, and one-third at MTT and 
Camegie-Mellon. Nationally, foreign students were 26 percent of the graduate student population in 1988. 

• Among U.S. citizens, minorities represent one-quarter at Houston, but only 1 3 to 14 percent at the other three 
universities. Tlie national average, unchanged since 1983, was 18 percent.^ 

In actuality, little is Icnown about Ph.D. supply.' In the words of the National Research Council: "Basic 
descriptive statistics such as the percent of entering doctoral students who never complete the degree are unknown. 
More complicated issues such as determinants of degree completion (e.g., financial support, family responsibilities, 
demography, and tir.w to complete the degree) remain unanswered. "< National trends in graduate student 
enrollments tell only part of the story of factors affecting the renewal of human resources in science and engineering. 

>Tbe <latA repoftfid below in btied oa unpubliihed Natioiul Scieoce Pouadatloo daii compiled by tbe Diviiioo of Scieace lUMOicca 
Studies. 

^Tlie natioiul d«tt are drawn from Natloaal ScteiKc Board. Science A Engineerint Indicatorh^im (Waitalogton, DC: 1989), pp. 
215-216. ubiea 2-7 and 2-8. — /.w 

'Thii lanple of four teitltutlotu akxie luggeati that research-inteoiive aulvenities may iiader'eiiroU woioea and U.S. isiaoHtiea wA 
over-eitfoU foreign natiooali in fnuhMte tcience and nginecraa ittk^ relative lo national trcodi. CIA's Maly^ ol Univenity of Michigw 
and Stanford Univenity is coosisteot with these flndingi across all fields of scieace and (Ogioeering as well, with woeoaicotnpniaislng 28 and 
22 percent, respectively, and foreign nationals 34 and 30 percett. of gradtiatc osolliiKats. But geoetnlizatioas ai« prwnatwe until more 
systematic analysis is imdettakee. 

^Alan Pechter, executive director. OfTiee of Scicntilic and Engineering Personnel, National Researdi Covncil, persoonl commwiicatiou. 
Oci. 23* 1990. 



F-ields vary in their dependence on sectors of ofall engineers and 25 percent of computer scientists 
etnploytnent. Basic researchers with a Ph.D. in some doing basic research in 1987. The field experiencing 
fields—mathematics, sociology/anthropology, and the largest percentage increase in industrial employ- 
economics — {ire employed almost exclusively in ment during the decade was the life .sciences (in large 
acadeinia. Indusuy, in contrast, employed 19 percent part due to ilie biotechnology boom)."* 



'•ibid The National Science f-ouiulation al.so reiMiris ilmt rcicniion of iiutlc tJocioral scienti.st.s aiid en«ii)c«rs is Uic higlicsl f»>r ihe bu.siiicss/industry 
and uiuvcrsily/collcge sectors, around SO percent, after 14 years (.sec pp. 1 17-1 IK for a di.scu.Hion). 
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TiUf 7A-1-Gratfuatt Enroflimnt tn Seltnet and EnglnMrtno at Salaetad Univataitiai, by Fiald: 1980^ 



mtlcMitottb 

Math/ Envfron- 

Ibtal Sooifll Lift ootnputer Pttyttoai nwiital 

Yaar ituchMitt Enyin— ring jdenoei idenoet idenct Piyehoteoy ■dtnot aduct 

1980 208,232 20.1% 27.7% 21.8% 7.3% 10.4% 10.7% 4.8% 

1983 223.135 23.8 21.5 20.0 8.8 9.0 11.0 5.2 

1988 238,741 24.9 10.9 19.2 10.6 9.3 11.4 4.8 

1988 245.483 25.1 20.1 10.1 10.8 9.5 11,3 4.0 

Unlv9nilty of Houston 

Math/ Environ- 

Total Social Ufa oomputar Physloat mental 

Year etudenti Engineering eclanoee tdenoes edenoe Psychology edencea idencas 

1980 766 24.8% 12.7% 20.3% 9.5% 15.5% 14.3% 2.7% 

1963 864 31.1 0.6 16.9 13.0 5.7 18.9 4.9 

1986 1,165 29.0 0.5 13.6 13.7 14.2 16.5 3.4 

1988 1.017 29.1 9.5 14.2 13.1 15.5 15.8 2.0 

CumoglO'llMlon Unlvonlty 

Math/ Environ- 

Total Social Ufa computer Phyiloal mental 

ViM>r students Engineering idenoes edences idence Peychology edenoes edencee 

1980 796 47.4% 18.8% 2.9% 18.2% 1.6% 10.9% 0.0% 

1983 965 44.0 21.7 3.2 18.8 2.1 10.3 0.0 

1886 1,115 46.4 17.9 3.3 20.3 1.7 10.4 0.0 

1988 1,137 45.8 18.6 3.6 19.5 2.5 10.0 0.0 

lllas$aehu$§tt$ inMWuto ot Tbchnology 

Math/ Environ- 

Total Sodal Ufa computer Physical mental 

Year students Engineering sdenoes sdenoes sdenoe Psychology sdenoes sciences 

1980 3^04 62.0% 10.2% 7!5% 3;o% 51% 12!9% 3.5% 

1983 3,705 61.6 10.8 7.1 2.9 0.9 13.0 3.6 

1986 3,925 56.2 11.6 6.4 8.1 1.1 13.0 3.5 

1988 3,827 54.0 11.9 6.3 3.5 1.4 13.9 3.5 

Unlwonfty ot CMlomithSanta Barbara 

Math/ Environ- 

Total Sodal Ufa computer Physical mental 

Year students Eng;.>eering sdenoes sdenoes sdenoe Psychoiogy sdenoes sdenoes 

1980 1,142 25.2% 27.8% 17.4% 4.9% 4.5% 14.5% 5.6% 

1983 1,178 27.6 25.6 16.0 4.8 4.1 16.1 5.9 

1986 1,262 24.2 25.0 14.4 12.0 4.3 15.1 4.9 

1986 1,293 28.3 22.0 14.6 13.4 37 13;0 4.0 

NOTE: FuN-lim* sludwia ontyl ~~ ^ " ~ 

SOURCE: N«lional SeUnc* Bovd, SotatrtM 4 Engln*^ MMoft-IMfi (Wuhindton, 00: U.S. GovcmnMfll Prtnting Offlo*. 1B88). labi* 2-16. 
p. 228; and NalkKi>l 8d«nM Foundation, (nttitutlonal ProlllM o( tha Univarilty of Houaton, Carnagia-Malon Unlvar^lty. MMaachuaMla 
in«<ilula of Tachnotosy, and Unlvarally of Callfofnta-Santa Barbara, unpuUithad Information. 1989. 



Complicating the understiuiding of employment 
trend.s i.s that temponu-y, 1- to 2-year appointments 
are a tradition in .some fields. Postdoctoral appoint- 
ments are used both to augtiient the specialized skills 
acquired in doctoral study iuuJ to wait out poor 



employment markets."' The number of Ph.D.s ti»k- 
ing postdoctoral positions in U.S. universities has 
grown 5 percent iinnually since 1 980. The availabil- 
ity of these appointments expand with academic 
reseiu-ch budgets, and over one-half of these posi- 



'Tradiiionaliy. iIk; posidocloral appoiiilnicm is for 1 lo 2 years llie la.si nwjor ailioiwl study of posidocioraics. iwwevcr. is a decade old Ifiis issue 
needs lo be revisited eiiipiricaliy. for a imiional pcrspettive. see Naliotial Research Council. Postdoctoral Appointn\ents ,ind Disappointmrnts 
(Wiishiiigum. IK' National Academy Press. I9H1). Tor a firsi-pcrsun perspective on liow circuni.stanccs nuy be chariguig. sec lUlward J Hacketu 
"SviciKc .IS a VtK-aiiBlhJJVllll^Jij/^rjji^j/^j^/iff Eduattum. vol 61, May/Jiuie 1990. pp. 241-279. 
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Figure DtstrltMition of Ooetoral Scientists and 
Enginssrs in Aeadt mie R&D, by Flsid: 
1977 and 1987 (inptrcsnt) 
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Figure 7*6-Average Annual Percantaga Growth 
Rata of Ooetoral Seientista and Engineers In 
Aeademie R&D, by Field: 1977-87 




1977 



1967 



SOURCE: National Sdanca Board. Sci0nc0 4 Engin^^ting tndlcator^^ 
1089, NSB 69-1 (WathinQton, DC: U.S. Govarnmant Printing 
Off lea. 1Q89).app. tabla5-17. 

tions are located in the life sciences. Foreign citizens 
have been increasing their postdoctoral appoint- 
ments at a rate twice that of U.S. citizens in the last 
decade.^^ Also, universities have increased the 
number of available nonfaculty research positions, 
and that the number of nonfaculty researchers as a 
percentage of die total numbci of Ph.D.s in s/e 
employed in academia rose from 14.8 percent in 
1977 to 17.5 percent in 1987 (see box 7-B). 

In sum, there is a steady stream of new entrants to 
the research work force. Ahnost 14,000 s/e Ph.D.s 
are granted each year by U.S. universities to U.S. 
citizens (nearly 13.000) or to foreign citizens who 
are peimanent residents (over 1,000). Industry and 
academia have increased their employment of 
Ph.D.s in s/e over the past two decades, and by rates 
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aoientiata 

Phyaioal 
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SOURCE; National Sdanca Board, SciMC0 A Engin—rtng MkuHon^ 
1969, NSB aa-l (Washington. DC: U.S. Govarnmant Printina 
Offica. 1d89). app. tabla5-17. 

exceeding 5 percent per year in the 1980s. In 
addition, relatively temporary university positions, 
such as postdoctoral and nontenure-track research 
slots, have increased. 

Historically, the Federal Government has played 
both a direct and indirect role in the production and 
employment of s/e Ph.D.s. Both as the primary 
supporter of graduate student salaries and tuition, 
and as an employer through the Federal laboratories 
and mainly through research grants, the Federal 
Government has perhaps the largest role in the s/e 
Ph.D. labor market. With changing demographics 
and demands on the research component of this labor 



»NAtional Science Bovd. op. cil., footnote 4. p. 54. There ii both a **push" and *'pull** factor operating in the postdociomtei taken by non-U .S. 
citizens witb Ph.D.i. They may be ineligible for employment in wmt sectort, e.g., defence, and they can be productive reaearcben wtiile awaiting a 
change in visa lUtus from temporary to pennanent. S. 358. passed in the 101st Congress, would allow the annual number of employment-based visas 
to increase from 54.000 to 1 40.000. Up to 40.000 visas are reserved for academicians and others with * 'extraordinary ' * ability to work in the United Sutes, 
An annual cap of 65.000 H-l. or temporary professional, visas was also Imposed. Sec Janice Long, **U.S. Immigration Based for Profeulonals." 
Chemical & Engineering News, vol. 68, No. 47, Nov. 19, 1990, p. 13. 
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Figure 7-7— Employmt nt of Doctoral Solentlitt and 
Englnoars In Basle Resaarch, by Sector: 1987 



Total einployKl: 193.346 




Aetd»mla 70% 



Othtf 3« 
Nonprofits 4« 

Ftdcril 

Oovvrnnwnt 7% 



Industry 9% 



SOURCE: Natronal Sd«nc« Board, SoImc* i En0n»»ring InOcaton^ 
1989. NSB 89-1 (Washington, OC: U.S. Oovarnmant Printing 
Offica, 1989), app. tablaS-19. 

force, the Federal Government could redefine that 
role as more or less interventionist in the 1990s. 

The Shape of the Future Research 
Work Force 

In recent years, the scientific community and 
some Federal research agencies have intensified the 
call for increased support of human resources. One 
emphasis has been on the educational "pipeline"— 
how to attract more elementary and secondary 
school students to science, mathematics, and engi- 
neering.^' Since the school-aged population will 
begin to grow with the second baby boom in the 
mid-1990s, most research agencies have initiated 
programs that emphasize earlier stages in scientific 
education, especially at the secondary and under- 
graduate levels.22 Not only will this population 



grow, but a larger proportion of it will consist of 
racial and ethnic minorities. 

The Uncertainty of Ph.D. Projections 

Another focus of concern is the state of graduate 
education in s/e. Some recent reports have projected 
that, in the 1990s, many scientific fields will 
experience shortages in the supply of Ph.D. re- 
searchers.^^ Based on demographic characteristics 
alone, NSF has estimated that the number of new 
Ph.D.s awarded in the natural sciences and engineer- 
ing by U.S. universities (to U.S. citizens and foreign 
nationals) would rise from roughly 14,450 in 1988 
to 15,600 in 1993, but then would decrease to 14,200 
by the year 2010. This projection, based on a 
predicted "shortfall" in natural science and engi- 
neering baccalaureate degrees, assumes little change 
in the proportion of U.S. doctorate-seeking students 
and that the number of Ph.D.s awarded to foreign 
nationals remains at 4,500 per year.^ 

lb convert these figures into a future supply of 
Ph.D.s for the scientific labor market, one must 
assume that some proportion of foreign nationals 
will seek to remain in the United States for 
employment. Most estimates assume that the current 
level of 50 percent will hold throughout the 1990s, 
while noting that increased scientific sophistication 
of these students' native countries may eventually 
draw a larger proportion of them back home. 

If the cunent demand for Ph.D.s in academia and 
industry, at over 12,000 per year, were to remain 
constant, then the aggregate supply of Ph.D.s in the 
1990s would be more than adequate. (This would not 
mean, of course, that the distribution among s/e 



2'For a review of the factor* influencing tbe early ilages of the pipeUoe. lee U.S. Congresi. Office of Tbchnology Asiesszneni, Elementary and 
Secondary Education for Science and Engineering. OTA-TM-SET-41 (Waihington. DC: U.S. Oovemment Printlnf Offlce, December 1988); and D.B 
Chubin. "Miiinfonnation and the Recruitment of Students to Science," Bioscience, vol. 40. No. 7, July/Auguit 1990. pp. 524-526. 

**rbe NaUoail Science Foundation has been particularly active. See Erkh Blocb, "Education and Human Reiourcci at tlK National Science 
Foundation," Science, vol. 249, Auf. 24. 1990, pp. 839-840; National Science Foundation. "Background Material for Long-Ruure Planning- 
1992-1996." NSB-90.81, prepared for a meeting of the National Science Board. June 14-15, 1990. p. A-5; Ward Worthy, "Reiearch Univertitiet Pay 
More Heed to Freshman Science." Chemical St Engineering Newt, vol. 68. No. 18. Apr. 30, 1990, pp. 27-28; and Mac Mm Mdkeaburg. "TVmung Off 
Students: Our Gatekeeper Councs." Engineering Education, vol. 80. No. 6. September/October 1990, p. 620. For a new conceptualization of 
undergraduaterecruitment and retention, see Sheila Ibbiu. They' re Not Dumb. They're Different: Stalking the Second Tier CHwion. AZ: Research Corp.. 

^?ot example, see Association of American Unlvenities. op. cil.. footnote 13; Janice Long, ' 'Changes in Immigration Uw Eyed lb Avert Shortage 
of U.S. Scientisu." Chemical A Engineering News, vol. 68. No. 34. Aug. 20, 1990, pp. 19-20. and Richwd C. Atkinson, "Supply and Demand fw 
Scientisu and Engineers: A National Crisu in the Making." Science, vol. 246. Apr. 27. 1990. pp. 425-432. Ubor economist Michael Finn has noted 
that "shortage* ' is a relative concept. "Increasing shortage of scientists and eogineen" means that they wiU be harder to find thm they are now, or were 
in the recent past. The difficulty in measuring sboruge is that hiring standards and personnel budgeu adapt to supply and demand conditions Sec Michael 
O. Finn, "Personnel Shortage in Your Future?" Research-Technology Management, vol. 34, No. 1. January-Februaiy 1991. pp. 24-27. 

^iled in A'Jiinson, op. cit.. footnote 23. 
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Box 7-B— The Unfaculty: Who Are They and Why Should We Worry? 

Graduate student enroliment increased rapidly during the 1960s, followed by a decline in the rate of increase 
in the 1970s and early 1980s. Because undergnduate and graduate student enrollment levels are closely associated 
with fimding available for focuhy salaries. It is not surprising that there was a decline in faculty job openings and 
a rise of "academic marginals" or research professionals, most possessing the Ph.D. but lacking t faculty 
appointment. This cadre has also been referred to as the "unfaculty," "unequal peers," or "research associates." 
In an effort to maintain an appropriate research base in the face of increasingly tight budgete, universities employ 
academic nuuginals on short-term contracts. These new nonfiiculty positions do not depend on enrollment levels 
and afford the university flexibility in ftilfilling its research needs since marginal positions are more readily emptied 
and reallocated than are tenured and tenure-track fiacul^.' 

Who are these academic marginals? Many are postdoctoral fellows who. unable to secure faculty poshions. 
remain in the university setting for an indefinite period of time. These positions might be viewed as extensions of 
the sci :jntific apprenticeship system, which includes graduate education and postdoctoral training.^ Of die fiscal year 
1972 graduates who had taken postdoctoral appointmenu. approximately one-third had prolonged their 
appointments because they could not find other desirable employment.' Consequently, these professional research 
scientists tend to be highly qualified and capable, most earning Ph.D.s from reputable research institutions, have 
impressive publication records, and are supported by National Institutes of Health and National Science Foundation 
(NSP) grants.^ Yet. academic marginals are not recognized as fiiU faculty members; they receive none of the 
amenities and privileges of faculty and. more important, are ineligible for tenure. 

The inferior status associated with the unfaculty fosters negative feelings and U iisions within the research 
community. Comparatively low salaries, little job security, and limited "rights" to laboratory and office space or 
seed money and equipment all contribute to an environment in which the marginal scientist commands little respect 
from his or her full faculty peers. In fact, academic marginals often are dependent on faulty to provide part-time 
teaching or research that augments employment. Similarly, the academic marginal might find it difTicult to establish 
him or herself in the scientific community at large: lacking an established laboratory and the accompanying prestige, 
marginal scientists have a ". . . longer row to hoc than most . . . [and] have to be more perfect."' 

Standards vary on the research status of unfaculty and are a source of debate on many campuses. For example, 
research associates at Stanford University cannot act as principal investigators on research grants, which prohibits 



<U.S. CongTcu, Office of Itehnoli^ Aiiessmeoi, Hightr Education for Scienct MdEngiiuering, OTA-BP-5(!T«32 (Washliutoa DC: 
U.S. Oovenmefll Prindng Office, Mvcb 1989). p. 176. 

^Edwvd J. Kackett. "Science in the Steady State: Hk C3uu>itine Reieaich Univefitty and Rdenl Riodliia," OTA contiactor report. 
1987. p. 18. Available throu^ the National Itahnical Information Service, «PB 88-177 928/AS. 

^National Reaearch Couocil, Potidoctoral Appointmtnts ondDitappoiimem (Wathington, DC: National Academy Pieii, 1 98 1 ), p. 225 . 
^Hackett. op. cit., footnote 2; and Mom H. TWch, "ReiearebCenten and Non-Faculty Reiearcben: A New Academic Role." Reswch 
in the Age of the Steady-Slate Univenity, Don PhllUpi and Benjamto Sben (eds.) (Boulder, CO: Wettview, 1982), p. 100. 

^Sec Edward J. Hackett, "Science as a VocaUon in the 1990'i," Journal of Higher Education, vol. 61. May/June 1990, pp. 2S3-2S4. 



field.s would be "correct.") However, these calcuhi- 
tioiLS further project that .'le demand for Ph.D..s. 
which has been ri.sing in Ih-. 1980s, will continue to 
increa.se. Several factors iire cited: 1) replacement of 
currently employed s/c researchers due to retire- 



ments iind deaths; 2) rising college and university 
enrollments in the mid-to-iate 1990s to accommo- 
date the second baby boom (therefore requiring 
more faculty); ajid ^) increasing Federal and indus- 
trial investment in R&D. if only at a moderate rate." 



- Rcscmh univcrMtics li;ivc (hf resources lo plan for possihlc (lisvnniitiuiliirs in faculty :igc a/ul tenure status. Other categories of insfitution.s. 
especially coniprelicii.s!vc universities and 4-ye.ir colleges, will tuive less latitude m coping with imbalances in faculty supply and deiniuid. which may 
tx- exacerbated with rccisionof the mandatory retirement l.iw in 1993 Some alternatives, mduding the consolidation or elimination of dep.-innicnts and 
how. If ai all. reliring faculty will Ik- replaced, arc discussed in Mii/cia Haiinaga. '■Howard .Sctuichmaji Fights Retirement." Scu-na: vol 249. Sept 14 
1990. pp. irvs, 1237. Con.si.incc H Bouchard. • fhe l^ist Gcncratioir of Scholars Can Help Colleges Avoid the Uwining Faculty .Shortage " /Tic 
Chromdf of Higher Uuratton. vol .17. N„ |2. N„v. 21. I9'X). pp ni-B2 .ml Couniiey Ix-athemun. "End of Mandatory Rcurcmcnl Policies Seen 
Having l.ililc hffoclon IWessors.*' The i'hmni, If ,>f Hinhrr Unaiiinn, vol 17. No 17. Jan. 9, 1991, pp Al .3-AI4 
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them from gaining a histcny of fiuiding with any Fedeial research agency. (Thit anangement is fairly tyi»cal for 
research associate positions across the United States.) 

It is possible that academic marginals are merely the product of a research environment that is shifting its focus 
and reevaluating its needs. But evidence that women have long been marginalized— less likely than men to land 
faculty posts or receive tenure once in them— in scientific research is unequivocal.^ So fimding pressures alone 
cannot explain swelling of the ranks of the unfaculty. Uke the rest of the research wwk fmce, a panoply ci 
demographic and funding changes may redeflne the perceived needs of research universities. "Die status of those 
funded entirely on soft money may be reassessed as the costs of sustaining research units are scrutinized by acadnnic 
administrators. 



Surprisingly, national data beyond per-inves- 
tigator costs are scarce on various "inoduction" unhs 
of research. This includes the extern to which the ranks 
of academic marginals are growing. Unpublished data 
on research personnel at 4-year colleges and universi- 
ties compiled by NSF (which warns thitt the data may 
not be comparable for different years) are presented in 
table 7B-1. Overthe period 1977 to 1987, the proportion 
of Ph.D.s without faulty rank grew slightly. Orowth 
in the number of unfaculty, up 15,000 in die decade to 
a total of 37,000, suggests that this is a sizable reserve 
research labor force to augment university faculty 
capabilities. Beyond that, little is known ab<Hit: 



Tablf 7B-1— RMMfch Ptrsonnal it 4-YMr Colttgts 
•nd Uniwrtttif • (based on ie!f*ldentiflcatlon) 





1977 


1881 


1087 


Ph.D.a with faculty rank 


85.2% 


83.9% 


82.5% 


(assistant, associate, full) 








Ph.D.s without faculty rank 


14.8% 


16.1% 


17.5% 


(InoiudtB postdoctorates) 








Total number 


157,000 


179,000 


209,000 



SOURCE: National Sdanoa PouodaUon, Sdwica RaaoufOM Studlaa 
Division, unpuUithMi data, July 1N0. 



1. the cost to the Federal CSovemment, which pays the salaries of unfaculty who arc supported on research 
grants; 

2. the career paths and prospects of the unfaculty; and 

3. the possible mobilizaticm of the unfaculty in the face of impending faculty retirements in the 1990s and 
projected shoitages of Ph.D. scientists and engineers early in the next century. 

Until better information is coUtiCted and analyzed on the unfaculty* Federal policymakers mutt worry about 
who they are and how they affect the university research economy (tf the 1990s. 



^ee Mupret W. Rouiter, Women Scienrim in America: Struggles and Strategies to 1940 (Baltiinore, MD: The JMoi Kopkios 
UnlvOTity Press, 19»2>; I* Jioa 0. Abtr*AiD and Dorloda Outnun (edi.), Uneasy Careers andtntimati Lives: Women in Science, t789^t979 (New 
Bninswick, NJ: Ru'^en Univenity Prets, 1 987); aod Viviao Oornlck, Women in Science: !Q0 JoHrntysinto the Ikrritcry, reviled ed. (New Yock, 
NY: SimoQ tt Schuster/Ibuchsiooe, 1990). 



However, OTA cautions those who wish to use 
these projections to predict future supply and 
detnand for researchers. Projections of shortages and 
surj^luses in the Ph.D. s/o work force are notoriously 
unreliable. As OTA recently concluded: 

The job market for Ph.D.s is unusual. While it 
responds to denumd (in particular, national R&D 
funding) mul to inuuediaie re.search arid training 
support, the supply is particularly sensitive to 
I'ederal policies. As for quality, at the margins talent 



can be lured or di.scouraged to relieve shortages and 
surpluses. 

In addition, predicting the demiind for academic 
researchers is extremely complex.^^ As discussed 
al>ove, such predictions must include demographic 
changes, immigration trends, anticipated retire- 
ments» and the orientations iuui intentions of new 
entnmts to the research work force, as well as 
shifting Federal priorities iuid available resciu-ch 
funding. All of these are subject to change, and may 



*'^()*!A reat'ltfil ihis* conclusion on ihv. basis of cxiunining various imnlels of acadcfnic ami inituslnal niaikcls Six Off ice of Technology As^cssmcnl. 
op. cil . foolnolc 12. esjK»cially cfi.s 1 and 4. Recent independent confirmation of tins conclu.sion cornes in a cntujuc of a National Science Foundation 
model developai by its Policy Research and Aniilysis Division. See Alan Fechter. "Fnginccring Shortages and Sliortfalls: Myths and Rcaiitie.s,** The 
Undue. vo\ 20. fall IWO. pp U>.20 

•^Office of Tcchnt)logy Assessment, op cii , footnoie 2. p 160 

^ led 1 K. Youn. •'Studies of AjL'aiterrnt Markets :uid C'arecrs Afi Hisioncal Review. aJt-mu lMh(fr Markets arui Careers. David W. Brencman 
and lc*l I K Voun (eds ) (FhdadelphKi, FA The Faliner Fress. l^KK). pp 8 27 

ERIC Z?.'; 



216 • Federally Funded Research: Decisions for a Decade 



vary by type of educational institution one attends, 
the field of Ph.D., the region of the country in which 
one seeks employment, and so on. Sorting these 
factors compounds the burdens with which poli- 
cymakers and educators must cope. 

In general, projections also do not take into 
account market adjustments: 

Most of the simulation models used to assess 
these labor markets assume . . . tliat if an imbalance 
occurs between supply and demand, nothing will 
occur to connect it. In fact, history demonstrates that 
these labor markets do tend to equilibrate. Thus* 
projected imbalances derived from such models — 
both shortages and surpluses — are always overstate- 
ments of what actually will be experienced.^ 

Finally, projections of future retirements and job 
availabiUty in industry vary to a large extent by field. 
For instance, some expect faculty shortages to be 
higher in the humanities and social sciences than in 
the mathematical and physical sciences, with no 
shortages foreseen in the biological and behavioral 
sciences.^ Also, the healtii of the pharmaceutical 
and related industries has a large effect on employ- 
ment prospects for Ph.D.s in medical and chemical 
fields. These factors must be taken into account by 
Federal policies that address projections of short- 
ages. As science policy statesman Harvey Brooks 
puts it: 

Most projections are based on extrapolations of 
recent history, usually considering only first deriva- 
tives, with little attention to second derivatives, 
which cannot be accurately estimated anyway. In 
fact the projection type of exercise has more often 
than not contributed to the tendency of the technical 
manpower production system to overreact, building 



up alternate surpluses and deficits owing to the 
delayed response of the educational pipeline to the 
conditions in tti;^ market.^^ 

Oiven the uncertainty of projections, OTA fmds 
diat concentration on the preparedness of the pipe** 
line to produce Ph.D.s (i.e., increasing the number of 
undergraduates earning baccalaureates in s/e) is the 
most flexible policy If shortages begin to occur in 
a particular field, prepared undergraduates could be 
induced by increased graduate support to pursue a 
Ph.D. in that research area, and Ph.D. production 
would increase 4 to 7 years later. In addition, those 
scientists who would have otherwise left the field 
might stay longer, those who had already left might 
return, and graduate students in nearby fields could 
migrate to the field experiencing a shortage.^^ 
(These are all signals of opportunity sent by the 
market.) 

If shortages do not materialize, then the Nation's 
work force would be enhanced by the availability of 
a larger number of highly skilled workers. Research 
in the United States would also benefit by the 
training of a larger number of baccalaureates in the 
sciences, a significant percentage of whom will 
choose to pursue scientific careers regardless of 
predictions of shortages, while others contribute 
their acquired knowledge to other occupations. 

Concerns about the demographics of Ph.D. recipi- 
ents could also be addressed. Laws that prohibit 
discrimination, such as Title VI of the Civil Rights 
Act of 1964 and Title DC of the Education Amend- 
ments of 1972, justify support to groups defmed by 
the ascribed characteristics of race/ethnicity and sex, 



^echter, op. cit., footnote 26, p. 19. Also lee Eli Glnzberg. National Research Council, Office of Scientific and Engineering Personnel, **Scientinc 
and Engineering Personnel: Lessons and Policy Directions, * * The Impact ofDtftnst Spending in Nondeftnse Engineering Labor Markets (Washington, 
DC: National Academy Press. 1986). pp. 25-42. 

^or the academic administrator perspective, see Elaine Ei-Khawu, Campus Trends^I98S (Washington. DC: American Council on Education, 
19SS): for a diCferect perspective, see William O. Bowen and Julie Ann Sosa, Prospects for Faculty in the Arts and Sciences (Princeton, NJ: Princeton 
University Press. 1 989). On the difficulty of applying national projections to regional, institutional, snd field'Spccific academic markets, see Debra Blum, 
*'Many Studies of Puture Academic Job Market Are Said lb Be of Uttte Use to Policymakers.*' The Chronicle of Higher Education, vol. 37, No. 23. 
Feb. 20. I991.PP. A15. AI9. 

^^Harvey Brooks. ''Arc Scientists Obsolete?.'* Science, vol. 186. Nov. 8. 1974, p. 503. Also see Constance Holden, ''Do We Need More Ph.D.s. Or 
Is Fewer Really Better?'* 5c/e/ice. vol. 251, Mar. 1. 1991. pp. 1017-1018. 

^^From a market perspective. Ph.D.s ve skilled workers who experience low rates of unemployment. However, the Ph.D. worker thinks in terms of 
caxecT paths. ' •Undercmployroeof ' meaai that the person is pan of the NaUon's labor force, but not working in a position that takes fuU advantage of 
his or her training and skills. The fit, in ihoit. is not always good. 

'^Recall thai 25 percent of scientisu are in oonscience and engineering jobs. This is a huge potential reservoir for responding to fluctuations in demand. 
In general, people with science and engineering training are much easier to convert to other occupations than (he reverse. 
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respectively.'* The 1980 reauthorization of the 
National Science Foundation also created the Sci- 
ence and Technology Equal Opportunities Act 
(Public Law 96-516). In it. Congress declared; 

. . « that the highest quality science over the long 
term requires substantial support, from currently 
available research and education funds* for increased 
participation in science and technology by women 
and minorities. The Congress further declares that 
the impact on women and minorities which is 
pn>duced by advances in science and technology 
must be included as essential factors in national and 
international science, technology* and economic 
policies. 

With reauthorization of the Higher Education Act 
of 1965 scheduled for the 102d Congress* expecta- 
tions are high that ''significant and bold changes** 
will increase Federal aid to higher education institu- 
tions and students* especially historically Black 
colleges and universities.^ This legislation empow- 
ers Congress and the research agencies that have 
devised programs targeted to enhance the participa- 
tion of women and minorities in science to do even 
more.^^ Programs targeted to minorities* women* the 
physically disabled* and students in areas of the 
country where access to research institutions is 
limited* could help to expand the pool of potential 
scientists.^^ 



Training for an Uncertain Research System 

The unity of research and graduate teaching in 
U.S. higher education has sustained a vigor and 
creativity in research that is unparalleled in the 
world. The training of graduate students is also 
linked to the instruction of undergraduates in s/e. 
This section Hrst looks at the connection between 
undergraduate teaching and research and then at the 
traditional academic research model and some 
alternatives. 

Research and Undergraduate Teaching 

Calls for a ''new paradigm** for higher education 
ui the 21st century are now emanating from the 
presidents of research universities.^^ Most of these 
reforms call for improved undergraduate education 
and '\..a better balance between research and 
teaching.**^ A related need may also be to change 
the reward system of the university* since asking 
universities to augment the teaching of undergradu- 
ates may be misplaced if faculty continue to view 
this as a drain on their time that would be better spent 
doing research. This tension between the time spent 
on research and teaching at the major research 
universities and the use of graduate assistants as 
insUuctors for many lower level undergraduate 



^Conuoversy erupted in December 1990 over a Department of education ruling that "race-exclusive** scholirshipt arc discriminatory and ibould 
be disallowed. Tliit is seen as an aasault on Title VI. Were such a ruling ever upheld. Federal aid and therefore college attendiuice by minority students 
could be jeopardized. Sec Scon Jaicblk. '^Scholarships Set Up for Minority Snulenu Are Called Illegal;* The Chronicle ofHinher Education, vol. 37. 
No. 15. Dec. 12. 1990. pp. Al. A20; Kenneth J. Cooper. '*Administnitlon Revises Race<Bascd Grant Rule.'* The Washington Post, Dec. 19. 1990. pp. 
Al. A8; Ruth Marcus. **New Schol4rship Ruling Caught in Legal Cross-Fire/' The Washington Post, Dec. 18. 199a p. A8; and Julie A. Miller. 
"Alexander Vows to Rescind Policy on Scholarships^" Education Week, Feb. 13. 1991, pp. 25. 28. 

^^National Science Foundation Authori/Jtion and Science and Ibchnology Equal Opportunities Act. Dec. 12. 1980. 94 Sut. 301 1. 

^SeeTbomaj i. DeLoughry. "Colleges Welcome News Thai Rep. Ford Will Chair House Postsecondary Education Subcomminee.'* The Chronicle 
of Higher Education, vol. 37. No. 12. Nov. 21. 1990. p. A23. 

^^Office of Ibchnology Assessment, op. cil.. footnote 15. app. B. 

^Ii is clear that martcet forces alone will not increase (he panicipation of women, minorities, and the physically disabled in science and engineering. 
Policy intervention is required. Therefore, there is no inconsistency between letting the market operate for some segmenu of the sutdeot popuhitioo while 
targeting other segments through recniitment and retention programs. For examples, see Linda Dix (ed.). Minorities: Their Underrepresentation and 
Career (differentials in Science and Engineering, woricshop proceedings. National Research Council (Washington, DC; National Academy Press. 1 987); 
and Cynthia LolUr. "Access to engineering: New Project for Smdents and Faculty With Disabilities." Science, vol. 251. Feb. 22. 1991. p. 952. 

^^Prominent among them are the two institutions (hat OTA studied u cue examples, Stanford University and Univenity of Michigan. See Karen 
Grassmuck. "Some Research Universities Contemplate Sweeping Changes. Ranging Prom Management and Ibnure to Ifcachhig Methods/* The 
Chronicle of Higher Education, vol. 37. No. 2. Sept. 1 2, 1 990. pp. A 1 . A29-3 1 . Stanford 's reforms include various programs, most funded by a t5 million 
gift to the university. "... designed to give faculty members ranging ftom graduate teaching assistants to senior professors better incentives to 
concentrate on effective instnictiou." See Kennedi J. Cooper. "Stanford President Seu Initiative on D»acluug." The Washington Post, Mar. 3, 1991. 
P.A12. 

^assmuck, op. ctt. . footnote 39, p. A29 Also see Courtney LeaUterman, ' *DeflniUon of Faculty Scholarship Must Be Expanded to Include Teaching. 
Carnegie Foundation Says/* The Chronicle of Higher Education, vol. 37. No. 14. Dec. 5. 1990. pp. Al. A16-A17; and Alliance for Uodcrgraduaie 
Education, The Fmhrnan Year m Science and Engineering, Old Problems, Sew Perspectives for Research Universities (University Park^ PA: 1990). 
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Students at the University of Michigan walk on campus 
iMtwean classes. Undergraduate teaching Is an Important 
part of faculty responsibilities. 

classes has caused some to question the health of 
undergraduate teaching at these universities."^^ 

Another concern that stems from the tension 
between research and teaching is the relation be- 
tween providing more funds for basic research and 
improving both the institution's research perform- 
ance and teaching capability. A common perception 
during the 1960s was that Federal dollars that 
supported research also benefited undergraduate 
teaching because these top researchers would com- 
municate their excitement about developments ''at 
the laboratory bench" to undergraduate and gradu- 



ate students alike. In the 19809, with the separation 
between research and undergraduate education be- 
coming more pronounced at many research institu- 
tions particularly with many faculty "'buying out** 
of teaching responsibilities when awarded a large 
research grant), the connection between research 
progress and the cultivation of human resources 
grew more tenuous/^ 

Consequently, many research agencies see a 
larger need for funding undergraduate teaching 
directly. In addition, many faculty have proposed 
novel ideas. For example: 

What if the four-year colleges . . . began requiring 
the university departments whose doctoral students 
apply for jobs at the four-year colleges to provide a 
detaUed description of how they had prepaired those 
candidates to teach, as well as specific evaluations of 
their teaching skills? . . . Oranted, the most selective 
graduate departments at the top research universi- 
ties — those that aspire chiefly to staff the faculties of 
other prestigious universities— might not be espe- 
cially responsive. . . . Although institutions rou- 
tinely '"raid" each other for distinguished re- 
searchers, they hardly ever pursue outstanding 
teachers so aggressively. As long as that disparity 
exists, talented teachers will be captives of their 
current employers, with little leverage to extract 
greater rewards.^^ 

Indeed, growth in the employment of Ph.D.s by 
4-year institutions has been hearty for over a 
decade.^ 



^'Of paiticular concern U its effect on the recruitmeot of new baccAliurestei, ilnce tbey oyiy h«ve to wail until (belr lophomorc or Junior year until 
they are taught primarily by faculty. The utilization of graduate itudents for teaching poiti, however, can be quite valuable from the gr«duate itudent'i 
prospective, since these classes may represent one of the few opportunities to teach (though not necessarily liwm how to teach). In 1990, the Howan] 
f iugttf s Medical Institute announced a $30 million grant competition to strengthen undergraduate science education. Ninety-nine Insdtutiona, many of 
them liberal arts colteges, will compete for 5-year grants ranging from $500,000 to $2 miUioa Winners wilt be chosen on the basis of proven success: 
the proportion and number of graduates who, over the past decade, have gone on to medical Kbool or to earn doctorates in biologyi chemistry, physics, 
ormathematics. For background, see LixMcMilkn, "Hugheslnstitute Awards $61 Million for Science Education,** The Chronicle of Higher Education, 
vol. 3S,No. 38. May 31. 1989, op. A 1 9* A20; and Linda Marsa, * 'Howard Hughes Medical Institute Enriches Undergrad Science Studies," TheSciemist, 
vol. 5. No. 1. Jan. 7, 1991, pp. 28-29. 

^^See Anthony B . Maddox and Renee P. Smith- Maddox, ' 'Developing Onduate School Awareness for EngiiKoing and Science: A Model, * * Journal 
of Negro Education, vol. 59, 1990, pp. 479-490. mt connection has also arisen over requiring institutions of higher education receiving Federal 
assistance to provide certain information on graduation rates, broken down by program and field of study. See Public Law 10l-542« Title I— Student 
Right-1b*Kiiow, lOlst Cong.. Nov. 8, 1990, 104 Sut. 2381-2384. 

-^-Tbaching repuuitions are local, while research repuutions are global. Iliis applies even to prospective smdenu. The best studenu tend to flock to 
Institutions where faculty have the greatest extenud reputations. Richard Chait, *'The Pro-lbaching Movement Should Try Economic Pressures,*' The 

Chronicle of Higher Education, vol. No. 43, July 11, 1990, p. A3(5. 

^Prom 1975 to 1987, percentage inaeases in the employment of Ph.D. scientisu and engineers in 4-yeaj institutions ranged from 15 percent in 
naihematics to over 200 percent in computer science (albeit from a small base number in this field). Most fklds increased by 25 to 50 percent. For a 
discussion of these trends (based on National Science Foundation (NSF) data), see Commission on Professionals in Science and Ibchnology, op. cit., 
footnote 5, pp. 18-19. The role of research at these traditionally teaching institutiotts is also cause for conctrttv In flKal year 1988, of 21,000 research 
proposals submined to NSF for funding, 12 percent came from investigators at ''predominantly undergraduate institutions** and 8 percent of all awards 
were made to these investigator!, accounting for 5 percent of NSF funds awarded competitively that year. See National Science Foundation, FY 1988 
Research Proposal and Award Activities by Predominantly Undergraduate Instimtions, NSF 9(V36 (Washington, DC: March 1990), p. 3. Also see Linda 
B. Parker and David L. Clark, ' * Research at Liberal Arts Colleges: Is More Really Better? ' * Research Management Review, vol. 3, spring 1 989, pp. 43-55. 
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These calls for increased undergraduate teaching 
by faculty seek to alter an academic research and 
teaching model in the United States that may already 
be under strain. What follows is an examination of 
the academic research model and its contribution to 
human resources at the Ph.D. level. 

The Academic Research Model 

The predominant mode of academic research in 
the natural sciences and engineering begins with a 
research group that includes a principal investigator 
(most often a faculty member), a number of graduate 
smdents. one or several postdoctoral scientists, 
technicians, and perhaps an additional nonfaculty 
Ph.D. researcher. While this group may be woiking 
on a single problem funded by one or two grants, 
subsets of the group may woilc on different but 
related problems funded simultaneously by multiple 
project grants. (In the social sciences, tlte groups 
tend to be smaller, often numbering only the faculty 
member and one to two graduate students./' The 
"young investigator" problem must thus be seen in 
the broader context of other changes in the univer- 
sity as a research training site. 

During graduate smdy. along with self-teaching 
and learning from one's peers, much of what is 
learned comes directly through mentorship by pro- 
fessors, postdoctoral fellows, or nonfaculty re- 
searchers. In many research universities, professors 
are responsible for multiple graduate shidents at any 
given time, so that in a professor's career he or she 
may train over 20 (sometimes many more) Ph.D.s. 
As one observer commented: 

Simple arithmetic shows that training in a top 
laboratoiy at a top instimtion, combined with the 
requisite number of high-quality publications, does 
not by itself ensure anyone a position similar to that 
of his or her mentor. Most top laboratories graduate 
two or three postdoctoral fellows a year. 
. . . Multiply that by the large number of top labora- 
tories in the country, and it becomes clear that even 




PMa emtk Ohuek Pa/nltt. Naum Mid l^uliaeiMoiiB 3§nkM. 



Qraduati ttudanti wofk fn th« Ctnttr for fnt^Qiitad 
StudiM at Glantard University. RasMrch and taaching 
Qo harxMn-htnd In tmch of sraduatt training. 

in gcxKl times not all these young investigates and 
their reseafch progfams can be abs(Mbed into the 
National Institutes of Health system.^ 

In addition, the dominant model to launch a career 
as a young scientist is movement firom one research 
university to another with an assistant professwshipt 
the attainment of a first Federal research grantt and 
the re-creation of the mentor's professional lifestyle 
(i.e.t independent laboratory! graduate studentSt 
postdoctorates). For an institution to subscribe to 
this modelt unfortunately shifts much responsibility 
for awarding tenure from the department faculty to 
the Federal Government. While university officials 
say there is . . no fixed time in which researchers 
are expected to become self-sufficient through 
outside grants . . . researchers who have failed to 



^^Tbe expioiijaioo of competent greduate itudeott hai been i pereoDitS clurg^— iome memors keep tbetn irouod u kmg ai poulbk becMK ibey 
ire ulented cheap labor. Competilton for cenure-track positions requires refereed publicatiotis oq the retume of the oew Pto.D. Thb. too, may protoi^ 
the giraduate research career. Registered lime to the doctorate ioaeased from 1967 to 1986, ytt a recent National Research CbuocU stody suggests that 
the reasons for this increase cannot be readily deciphered. According to ont observer, the recent leveling off of this trvod In time to RtD. mny reflect 

. . changes in the job market fot new Ph.D. recipients. It will be interesting ... to see if the numbers faU^-as market*oriented theories would 
predict— when the expected increase in demand for faculty begins later in the 1 990i. ' ' See National Research Council, On Time to the Doctoratt: A Study 
of the I^nasidTinu lo Complat Doctoraas in Scitnci and Enginemng (WashingU)n, DC: Nail<mal Academy Press, 1990); Peter Syvenon, "NRC 
Releases New Study on Increased Time lo the Doctorate." CGS Communicator, vol. 23. August 1990. p. 8; and Paul Gassman, "Shortening the Time 
to a Pb.D.." Chemical A Engineenni News, vol. 68. No. 52« Dec. 24. 1990, pp. 25-26. 

^Dinah K. Bodkin, Young ScientisU and the Future.' ' letter. Science, vol. 249, Sept. 28. 1990, pp. 1485-1486. Of courae, some of these Pti.D.s wUI 
neither pursue an academic career nor compete for National Instiniles of Health funds. The situation is less predictaUe than the author's extrapolation 
suggests. 
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Box 7^C^?o\ni of View of a ''Smair Scientist 

The following are veibatim excerpts from a recoit *Toint of View'* column titled: *'We Need lb Give a 
Chance to Small, Unfashionable Science/* published in The Chronide qf Higher Education.^ 

While literally millions of dollirs aie being spent on massive^ cqaipmem*rich projects* other 'small' sciences 
are in real danger of drowning for lack of ftinds. . . . Ahhough I've received 22 grants from the National Science 
Foundation and a host of private foundations during Ute last IS years, grant mon^ is now muchharder to get. Support 
for anthropology has gone from modest to minuscule* 

'^There's no real problem/' I used to think while responding sympathetically to my peers' grosns over another 
rejected grant. "Oood science wiU always get funded/' I learned tliis magic fomnula from my mentors while I was 
in graduste school and thought that if I n^ated it often enough and believed it devoutly enough, I would be protected 
from disaster. But plenty of good scknce is not receiving support these di^s. . . . 

' 'The long-term trends are grim In the last 10 years, the number of grsm applications submitted annually to Uie 
National Science Foundation's anthropology [program has risen, as have the indirect costs of research. But the toud 
budget for the program has remained approximately constant in real dollars. Consequently, the percentage of 
applications receiving support has dropped. For exan^le, 32 per cent of the implications sulmined for archaeology 
research in 1980 were approved, compared with only 23 per cent in fiscal 1990. Whst*s more, the average dollar 
amount of the grants has dwindled during a period when vimially all the costs of actually conducting research have 
risen. John Yellen. director otiht foundation's anthropology program, said recently with asigh: * 'What seemed alarge 
but reasonable grant for us to fimd 10 years ago now looks out of sight". . . . 

' *I do not know where die next generaUon of field researchers will come from, because the odds against starting 
up a major project are so great now. I do loiow that without field researchers, anthropology will stagnate into a family 
feud and eventually wiU perish from sheer triviality 

**Some deliciously subde ways exist for a reviewer to sabotage a grant proposal, thereby blocking or staUing 
a panicular line of research. They range from simply giving a vaguely lukewarm review, to claiming falsely that the 
applicant has overlodced important work in the field, to planting poisonous questions about methodology that the 
review panel will then assume have not been addressed in the proposal. The temptation to engage in such unethical 
behavior is greater if eveiymie is feeling the pinch — Under these conditions, the review process becomes one of 
paring down the proposals to a manageable number for ranking, rather than deciding how many are good enough to 
recc^ive su(^rt. . . . 

"The dilenuiia for program directors is: With too linle money to go around, should they spread it around like 
fo<Hl supplies in a famine, giving everyone enough for a taste but not enough to maintain health? Or should they 
su{^rt fewer projects ntore fiiUy, condemning others to oblivion? 

* 'I would love to see a box printed on federal income tax forms saying, * 'Check here if you want one dollar of 
your return to go to support basic science research. '* Another solution is to guard against spending all of our money 
for megabucks projects with catchy titles that appeal to legislators. SmaU. unfashionable science, as well as big, sexy 
science, is impottant. Sometimes great ideas and staggering discoveries come from ttie linle guys with funny ideas, 
ponering away in the comer by ttemselves. We need to give them a chance. ..." 



^Thc author is Pat Shipnuui; the cohiinn appeared Sept. 26. 1990. p. A60. For aDother expression of related values, see Eugene Carfieklt 
'Tasi Science vi. Slow Science. Or Slow and Steady Wins the Race/* The Sdtntisu vol. 4. No. 18. Sept. 17, 1990, p. 14. 



win such iiianis are less likely to eani tenure than 
their colleagues who have found such support/"*' In 
many fields, young Ph.D.s and older ones as well are 
living; out this sccn;u-u) (see box 7-C'). 



As seen in the preceding chapter, nujsl universi- 
ties ciuinot afford to defray faculty reseitrch costs for 
very long, iind the cost of supporting students has in 
part been transferred to Uie rcseiu-ch budget.**^ The 



*'Srr{>cbf:ir: Hliiifi. •Vmih^jcr St \cu\\\\> I trl Bifc! Prt-ssufc ui Baulc for (Jranls/' TheChronu Iv i^fHi^ihrr Edumnim. vol M , No 4. St'pt 2fi. MM), 
p AU) As one rpstan.hfr pul il "Ix.'iul»ny univcfsiiics should make ihcif own dtxisions .ilwul who ihcir t.itully arc going to be. wul not Icivc il lo the 
^fu^ly sotlioiisjif NIH " Qunicd in Davul Whcclcf. "liiomcdkal Kcsr-itKhcrs Sock New Sources of Aid lor Youn^i Scicnlisls." The ('hronuU' of Higher 
tMw auon. vol ^6. No 42. July 5. p A2.i 

^'*Hcseafcha\Msiantsh»i)s ex|)oriontcd \\w |^rc.lU•^^ URri-asc as the suppoit nu\hanisn) tor sticnce and erigmecrin;? studcnls from 1980 fo l^XX Sec 
Nahonal Sv.icmc Bo^ud. op cit . liM)inotc 4. Iigufc .I I I. p 
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combined costs of set-up and operation alone (which 
for the typical chemistry or biomedical laboratory is 
on the Older of $200,000 to $400,000)^' have 
ballooned. The priority of this academic, individual 
investigator-based research nwdel has be(;ome in- 
creasingly difficult for some institutions, fields, 
departments, and faculty mentors to maintain. 

Hie Federal research system is presently trying to 
cope with growing demand for research monies, as 
measured by proposals submitted to the research 
agencies.^^ A potential shift of members of the 
research work force out of universities and into 
another sector, or into academic work diat is not 
research-centered, can be recognized as normal 
labor market adjustment. Such movement would 
testify to the versatility and adaptability of Vh.D. 
researchers and to the Nation's ability to utilize their 
talents.^' 

Computer science is just such a case example. 
About 800 new Ph.D.s in this field are granted 
annually in North America, double that of a decade 
ago. The demand for new faculty has slowed, new 
departments are not being created, and existing 
departments are not expanding. Industrial and gov- 
ernment computer research leaders asked: 

. . . whether the current siniation warranted concern 
(i.e., is there a Ph.D. surplus, or are the supply and 
demand levels reasonably in balance), Repoits of 
graduating Ph.D.s not finding the kind of academic 
positions they desired . . . [lead to] the suggestion 
that the expectations of these graduates need to be 



adjusted Not eveiy bright, new Ph.D. will find an 
academic poshion in a top-tier research univenity. 
Postdoctoral positions in computer science are 
beconUng mme common, and ... graduates will 
need to look toward second-tier research univenities 
as well as four-year colleges in order to fiilfiU their 
career objectives.^^ 

There is doubtless a role for universities to play in 
the diversification of research careers of recent 
Ph.D.s.'^ New Ph.D.s fmd it difficult to entertain 
alternative opportimities if they have no experience 
with them, llius, programs that offer a summer in a 
corporate laboratory or part of an academic year at 
a liberal arts college can help advanced graduate 
students visualize working in settings other than the 
university. Arrangements that link a historically 
Black college or university or liberal arts college to 
a research university or national laboratory stretch 
the resources and experience of both participating 
institutions.'^ 

If the career prospects that new Ph.D.s confront 
are so different from what they were taught to expect 
and value, there can be a crisis of confidence. As one 
university administrator states: 

We are giving out mixed signals. Universities are 
competing intensely with one another to hire the best 
young Fh.D.s. On the other hand, the positions (at 
least in many fields of science) available to the 
average but quite capable Ph.D. are not veiy 
anractive. Moreover, many very good students are 
turned off when they see what the young faculty are 
up against.'^ 



repoft on ut-up cosu in chemiitiy u ihe University of Mlnnetou ihowi fouxfold increasea from 1979-80 to 1989-90. See Paul O. Gauman, 
"Future Supply and Demand in Academic Instliulions." Human Resources In Science and Technology: Improving US. Competitiveness, Proceedings 
of a Policy Sympotium for Oovemment, Academla, and Industry, Mar, 15-16. 1990. Washington, DC. Betty Vetter and Eleaoor Babco (eds.) 
(Washington, DC: Commission on Professionals in Science and Ifcchnology, 1990), pp. 3^-36, 

^See U.S. Congress, OfTlce of Ibchnology Assessment, "Proposal Pressure in the 1980s: An Indicator of Stress oo the Federal Research System," 
staff paper of the Science, Educatioa, and Truisporution Program, April 1990. 

'*For a diKussion, see National Research Council. Office of Scientific and Engineering Personnel, Fostering Flexibility In the Engineering Work 
Force (Washington, DC: National Academy Press. 1990). Among the National Research Council cooclusloos are: a) that the production of adaptable 
engineers is impeded not by the engineering cui riculuiu, but how thai curriculum is delivered; and b) that continuing education could enhance adaplabiliiy 
in the engineering work force. 

"John R. While, "President's I-eiier; Rcflcclioiw on Snowbird," Communications of the ACM, vol. 33, Septemlier 1990, p. 19. 

^'Seller faculty advising of gritduate students is wi obvious need. See Carolyn J. Mooney. "The Disw»iation Is Still a Miluable Requirement, Survey 
Finds. Bui Graduate Studcnu Say They Need Belter Faculty Advising," The Chronicle of Higher Education, vol. 37, No. 18. Jan. 16. 1991. pp. AIS. 
A22: and Association of American Universities, Instimtional Policies to Improve Doctoral Education (Washington, DC: November 1990). 

'^Todate. sucharraiigenMnts have been most conunon in uudergntduate engineering. One coalition, spearheaded by a 5-year, $15 million National 
.Science Foundation grant, will csublish a comniuiiicaUons network for information dissemination, faculty exchange, workshops, and outreach to 
elementary, secondary, and conununity college studcnu . 'fhe participating universities are City College of New York, Howard. Maryland, Ittassachusetts 
Institute of Ibchnology, Morgan Sute, Pennsylvania Slate, uid Wasliington. See "NSF Announces Multi-Million [)ol]ai Grants lb Form Engineering 
Education Coaliilons,' ' NSF News, Oct. 9. 1990. Also see Oak Ridge Associated Universities. 1990 Annual Report (Oak Ridge. TN: 1990). Oak Ridge 
As.social6<l Univenities is a Department of lincrgy Uboralory and a consortium of 59 colleges and universities engaged in research and educatioiul 
progTinu in the areas of eiiagy, health, and tlie environment. 

^'Neui Lane, "Educational Challenges and Oppoitunitie.s," Vcitcr and Dabco. op ctt.. footnote 49, p. 94. 
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Universities are caught between the desire to train 
the next generation and the harsh reality that their 
research apprentices may face a different form of 
competition for resources (for a controversial exam- 
ple, see box 7-D). 

New Models 

The National Science Foundation recently an- 
nounced that the 20 research universities that receive 
the most NSP support "... will work together to 
improve science and mathematics education in 
schools and to increase the number of women and 
minority students and faculty members in science 
and engineering." Actions mclude changing tenure 
policies to reflect the extra family responsibilities 
often carried out by women and encouraging faculty 
to work with schoolchildren and teachers.^ 

Other models of education could be encouraged 
that feahire a greater sharing of resources (e.g., 
equipment and space) and people (e.g., doctoral 
students, nonfaculty researchers, and technicians). 
Models that stress research in units other than 
academic departments, research in nonacademic 
sectors, and nonresearch roles in academia could be 
entertained. These models are already being applied 
in the centers programs sponsored by NSP. Centers, 
which support individual researchers (as faculty and 
mentors) as well, m:.y represent a new way of doing 
business for NSP and the companies that participate 
in them.'^ 

In the 1980s, centers at NSP became the focus of 
political dispute.'^ At issue was the appropriateness 
of promoting such a mode of research organization 
in view of the basic research and science education 
missions of NSP. Por NSF, however, the centers 
complete . .a balanced portfolio of individual 




Photo endK: U.S. Dtpmlnml otEnotgy 



I nree iclentists work on a magnetfor the Superoonduotlng 
Super Collider. Usamwortt Is an Important part of 
research groups. 



investigator grants, facilities, and center activi- 
ties."^^ Engmeering Research Centers (ERCs) were 
intended to foster university-industry collabora- 
tions. As a 1988 General Accounting Office study 
found, participating companies **. . . expect to bene- 
fit over time -trough better personnel recruit- 
ing .. . [even though] it is too early to determine the 
program's impact on engineering education."^ 



»*See "NSF, Unlvenldei PUn for Womoi, JUaorijlej^" The ChroiticU (^Hithtr Education, vol. 37. No. I, Sept, 3, 1990, p. A2. locorponting 
Incentives for afTinsadve kUoo into prognunt Uul allocate retcarcb duUan uodencoief the importance of Iwauo reaouicea a» a crilerioo for Fedenl 
reiearch funding. II remaini to be ie<u whetber unlvenlties retpond— witb or without prodding by the Nidooal Scicoc« Fowidatioa. 

1990, the NMiouJ Science Foundation (NSF) npported 19 Ei^ineaiiv Reiearcb Ctam and 1 1 Science and Ibcfanology Rese«cb Centcn 
(STCO at m mUUoa and $27 mlUioo. respectively. Tbui, togctbcr Ibey accoom for leu Iban 10 percent of NSFi budget, wbile providi^ a loqt-lenn 
funding base (S to 11 yean) for iaterdlicipUflMy and Ugb-riikpnjecteoriemed to die allied, develofoeot,^ 

continuum. See Jotepb Paica and BUot Mataball, "Blocb Lnvca NSP in Mabutitam." Science, vol. 249. Aag. 24, 1990, p. 8S0. In the block-r«>t. 
multi-invetilgator approach embodied by STCi. "NSF bu rolled the dice on an experiment in wience. and it will lake loae dme to know wbetber it 
has come up with a winner." See Jowpb Pafca, "NSF Ccoten RLr« Above the Stonn." Science, vol. 251. Jan. 4, 1991, pp. 19-22. quote from p. 22. 
Alio we Jeffrey Mervli. "NSP CuU Back ou Faltering Science, Tfechnology Centcn." The Scientisi, vol. 5, No. 3, Feb. 4. 1991, pp. 1, 4, 24. 

"See Robert L. Piifc, "The Next Leader of the Natlooal Science Foundatioa Must Preai for a Greater U.S. Inveeimcat in Science." 7*e Chronicle 
<rf Higher Education, vol. 36, No, 48. Ao|. IS, 1990. p. B3. 

"John A. White. "Diiputing Some Claimi About (he NSF." ne Chronicle of Higher Education, vol. 37. No. 3. Sept. 19, 1990, p. B4. 

*^G<xKnl Accounting Office addr that". . tltbough ciw^l«}plmaryM«ljoimre«aicbare the goaU of ttaBRC program. Induitiy parti 
believe that the quality and type of rcacarch are more in^ortaut rea<on< for iponsoring ERCi." See U.S. General Accoonting Office. Engineering 
Research Centers: NSF Program Managemeiu and Industry Sponsorship, OAO/RCED-88-177 (Wathlngtoo. DC: August 1988), pp. ^3. 



ERIC 



231 



Chapter 7— Human Resources for the Research Work Force • 223 



Box 7-D— The Priority of Research Training 

In November 1990, the Institute of Medicine (lOM) published a report on priorities in health sciences: 
The charge to the committee was to analyze the funding sources for research projecu. training, facilities, and 
equipment by Federal and nonfederal sources^ The comminee was asked as well to develop a coordinated set of 
funding policies to restore balance among these components of the research enteiprise in order to ensure optimal use 
of research dollars. . . .The goal ofthesnidy was toensure that, at any given level of8uppon,aUocationpoliclesw 
enable the scientific conrununity to utilise available resources in the most efficient manner so as to create an optimal 
research environment and achieve society's goals for research into human disease.' 

First, by adq)ting * 'imbalance'' as a premise and then by concluding that if the National Institutes of Hfalth 
budget were not to grow over inflation in the coming decade (one of four ftmding scenarios considered by the lOM 
comminee), expenditures for research training and facilities should take priority. The repoit rankled the biomedical 
research community. Leading the dissent was the Federation of American Societies for Experimental Biology 
(FASEB), which objects to any diversion of funds at the expense of individual investigators.^ 

FASEB rejected the premise of the lOM report that in an era of tight budgets, biomedical funds should be 
balanced. FASEB claimed there is no imbalance, arguing that increased funds for training and construction will 
jeopardize . . productivity in the foreseeable future.'* FASEB president Thomas Edgington, an immunology 
professor at the Research Institute of Scripps Clinic, California, feared that implementation of the lOM 
recommendations would . . diminish advances of value to the iniblic." He continued: '*We advocate ... a total 
increase of support of the enterprise as a whole. ' ' So while committee chairman Bloom insisted: ' 'We're eating our 
seed com,'* Edgington concluded: ^Training has not decreased." Chemist Ronald Breslow« a member of the lOM 
committee, added another point on the training issue: 

Supporting training through research grants tics training too much to the success of the research advisor. Giving 
money to the snident rather than die sponsor changes their relationship. Trainees can then work on their own projects 
rather than being a son of employee, h's more encouraging to the snident to be told You are a winner" rather than 
• • Just go beg for su^wrt. ' '^ 

This public dispute highlights several points. First, it attests to the depth of anxiety that grips investigators m 
search of stable, muhiyear research funding. Second, by entertaining a ''no real growth'* funding scenario, the lOM 
repoit puts into black-and-white what few investigators want to contemplate, i.e., tight ftuiding could get tighter. 
Third, by favoring an increase of research training funds under the worst-case scenario, the committee removed 
research funds as the first priority. Indeed, "The committee believes that this growth in the training budget will not 
enlarge the research project grant applicant pool; rather, the net effect of this gradual reallocation will be to replace 
the increasing number of scientists expected to retire later this decade."^ 

This lOM report should be applauded for attempting to make forecasts and preparing for its consequences by 
systematically considering iHiorities ajnong resources. However, the conclusion to increase training funds is 
problematic.^ At present the system is producing an abundance of new Ph.D.s in biomedical fields. Enhancing this 
production while holding the line on the research grants that must support them is rightly open to question. 
Nevertheless, policymakers will welcome the lOM report for its look at a hard, complex problem and its statement 
of priorities. 



'institute of Medicine, Conunittee on Policies for Allocating Health Sciences Research Funds, Funding Health Sciences Research: A 
Strategy to Restore Balance, F.E. Bloom vut M A. Randolph (eds.) (Waahiiigton, 1>C: National Academy Press, 1990), p. 5. 

^Thc Federation of American Societies for Fjipchmcntal Biology criticism was reported almost simultaneously by: Bart>ara J. CuUiton. 
'TASF.B 'Rejects' lOM Study," Science, vol. 250, Nov. 30, 1990, p. 1 199; '^Strife ErupU Over Shares of Biomedical Funding." Science & 
Government Report voL 20. No. 19. Dec. 1, 1990, pp. 1-4; and Pamela Zurer, ^'Biomedical Research: Calls for Shifts in Funding Attacked.'* 
Chtrmcat A Engineering Sews, vol. 68, No. 49, Dec. 3, 1990, p. 6. Material quoted below comes from one or all of those sources. 

^Also see Ronald Breslow. *'FundiBg Science Research/' letter. Chemical A Engineering News, vol. 68. No. 51, Dec. 17, 1990, p. 2. 

"^Scc Institute of Medicine, op. cit., footnote 1 . p. 8. Also see National Research Council. Biomedical and Behavioral Research Scientists: 
Their Training and Supply (Washington, IX.*: National Academy Press. 1989). 

^'.dgingtnn ulso assailed the makeup of the lOM committee, saying Uiat it was composed nK)sUy of research administrators oiul liad few 
working scientists. 
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Tabit 7-l<^stuN In Tkam RaMareh Parformad In DIffarant Organizational Contaxta 



Kov Issues 


Small, unlversltv based 


Large, university based 

(organlied research unit) Smalt, Industry based 


Laroe. Industrv based 


Number of disciplines 


Small 


Moderate 


Moderate 


Moderate to large 


involved 








Typical research 


Pure 


Pure-applled 


Applled*pure 


Applied and pure* 


runoing 


Short term and 


Relatively certain 


By oontract and short 


applied 
Relatively certain 




uncertain 




term 


Source of research 


Found Dy team 


Pound by team (largely) 


Given by environment 


Pourxi by team and 


problema to be solved 


given by environment 


Structure of 


Rat 


Hierarchical (selective 


Plat 


Hierarchical (selective 


organlxatlon 




decentralization) 




decentrallzatiofi) 


Leader's Involvement 


Part time 


Pull time 


Parttlnw 


Pull time 






Relatively certain/ 


Uncertain 


neiaiiveiy oenam/ 


prospects 




predictable 




predictable 


Key leadership roles 


Outside liaison 


Outside liaison and 


Outside liaison and 


Motivation and 






coordination 


resource acquisition 


management of 










different teanw 


Communication 


Pew potentially 


Internal and external 


External 


Internal 


probfems 








Access to scientific and 


Good 


Good 


Not so good 


Good If affordable 


technical resources 









SOURCE: Adapted from Julie Thompson Klein. IntmdiMdptinvltyi Hiitofy, Thmy, MdPrK6bs (Detroit. Ml: Wsyne Stste University Press, 1090), table 1, 
p. 124. 



Research in general is becoming increasingly 
interdisciplinary, i.e., it requires the meshing of 
different specializations to advance a research 
area.^^ Academic departments house specialists by 
discipline whose research will be performed in 
units—centers, institutes, programs — tfiat cut across 
the traditional departmental organization on cam* 
pus. Such organized research units (ORUs) have a 
history on U.S. university campuses, but not as a 
dominant structure.^^ Klein writes: 

In the 1960s Federal legislation gave birth to 
several kinds of ORUs, including NASA space 
centers, water resource centers, and later, regional 
education laboratories. A number of ORUs are <ie 
facto independent of the university that gave birth to 



them» and Caltech's Jet Propulsion Laboratory is 
even larger than its ''nominal parent," Caltech.^^ 

Ibam research, whether interdisciplinary or not, 
takes place in many organizational contexts, subject 
to various influences^ (for a summary, see table 
7-1), While the disciplinary department still pre* 
vails, a wide range of organizational models are now 
employed by universities to manage and conduct 
research. The autonomy, formality, and permanence 
of these production units depend on adapting the 
demands of outside patronage to local custom and 
need, including the support and on-the-job research 
training of graduate students. 



'^'ForcxanjplcsccA I. Porter and D.F^Chubin/' An Indicaior of Cross-Disciplinary Rcscafch/\9n^^ I985.pp. 161.176; audDon 

R. Kash, "Crossing ilic Houmlaries of Disciplines," Engineerinft Education, vol. 78, No. 10. Novcnjbcr 1988. pp. 93-98. 

^^D.I. Phillips and B.P.S Sljcn {ci\^.). Re search in the A^e of the Steady-State University (Boulder. CO: Wcslvicw Press, 1982). Three models of 
organized research uniis fwhicli arc common in iiklusiry and ihe Federal laboralories) have taken root on campus— agricultural experiment stations, water 
resources research ccntcis. an<t engineering research centers. Sec Robert S. Friedman and Renee C. Friedman. "Science American Style: Three Cases 
in Academe. 'W/zo Studies Journal, vol. 1 7. No. 1 . fall 1 988. pp. 43-6 1 Several other models could be mentioned; e .g., the Joint Center for Laboratory 
Astrophysics ui the University of Coloratlo. tlic Center for Astrophysics (the Smithsonian Astrophysical Observatory- Harvard Astronomy Department 
Pannersliip). and the Materials Rcscaa*h Uboratories (supported by the National Science Foundation). 

<^^Julic Tliompson Klein. Interdisctplinarity: History, Theory, and Practice (Detroit, Ml: Wayne State Unlvcrsily Press, 1990). p. 123. 

*^Scc Donald Pel/ and hnmk D. Andrews. Scientists in Or^amzaiions, Productive Clinuitesfor Research ami Devehpment. revised c<l. (Ann Arbor. 
Ml. Uiuvcrsily of MiclMg.'UU liisiitule for Social Rcscarclu 1976). 
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Box 7-E— Flexibility at the Bectonan Institute 

The Bectonan InsUtute for Advanced Science and Tbchnology is locaicd on tlie University of Illinois 
Urbana-Oampaign campus and was buUt wltli a 1985 donation of $40 million from Arnold and Malwl Bectonan. 
In the words of its diiector. Theodore L.Biown,themisdon of the institute is'\..toadvancette 

sciences, physical sciences, and engineering through promotion of muhidiscipUnary and i^^^^^^'^^^i;^!^'^ 
of the highest quality," in particular . .to tnmscend the limitations of departmental stnicture/*»Over 700 fiac^^ 
postdoctoral associates, graduate students, and others work AiU- or pait*time at the institute. 

The instihite divides its research programs into nine muhldisciplinaty groups. For example, one gioig includes 
faculty in neuronal pattern analysis, cognitive neuroscience, perception, biomechanics, and molecular biology. It 
addresses a range of problems from the molecular level to cognitive science.' PWhaps most well toiown of the nine 
groups is the National Center for Supeicompuling Analysis, which performs research in the diverse use and analysis 
of supercompiiter-gennrated models. 

Tb maintain flexibility in its research missions and yet provide some measure of security for the faculty, the 
Beckman Institute has taken advantage of its position outside of the university departments and developed a • 'rolling 
appointment" system:' 

• Roughly 35 faculty call the Beckman Institute their full-time research home, although each retains a 
departmental affiliation. Faculty have 5-year appointments, which are extended eveiy year, as long as their 
research is productive for the instinite. If the appoinmient is not extended, then the faculty member has 5 
years in which to move back to his or her department (where thehr tenure is based). 

• Another90to 100 faculty members are part time at the instittite, and are based primarily in their departmental 
homes. Each has a 3'year appointment, which is renewed like appointments of full-time faculty, 

• Space is allocated in the instimte only for those who use it, and is taken away if insufficiently occupied. 
So far the system has worked well for the faculty at the insthute; it represents a novel attempt to maintain 

flexibility in the university environment. In the future, other institutes and centers may view the Bectonan Institute 
as a model. 



•See Ward Worthy, "New Beckman Instlmtc Promotes Broad-Rauging Rewareh Effort," Chemical A Engineering News, vol. 68, No. 
34, Aug. 20. 1990, pp. 23-24. 
2lbid., p. 23. 
'Ibid., p. 24. 



With the asceniiiincc of wluit OTA called in the 
la.si chapter the "imlu-sirial iiKulel" of re.seaich. 
change.s in the units producing knowledge have 
iK'coine apparent.'''* One coultl predict that univer- 
sity invesligalor.s vvill gravitate to tho.se unit.s that 
bring together the needed persomiel and ni.struinen- 
taiion. and ea.se the research process, e.speciaiiy if 
Federal luui other sources of support favor centers as 
efficient sites of research performance (see box 7-E). 
Does It mailer that research laboratories in iui 
academic department come to resemble iUi C)IU! - 



be it ;ui ERC, a supercomputer center, or iuiother 
campus-wide institute that is largely federally 
funded?'''' One physicist writes: 

Goal nrienteil reswirch ;uid a traditional K'licf in 
team inctluxls favor largo, centralized approaches in 
many industrial and Federal laboratories. (Small 
groups can also flourish in these environments— the 
two discoverers of high-temperature superconduc- 
tivity arc industrial SLienti.sts.) . . . I'or the same 
reasons that artists use different environments or 
new media to stimulate creativity, siientists need 
iliffcrent ways to do science, i'his will help ensure 



'•\Sucnco poln V si.ii.-sinaii Inl.n /mi.iti cliiiiHN ih.ii sucikc is ■ ix-mf. \()!loitiviW(|- in two .litlcrcm -icnscs of iho word Onihcoiio hami, .Uniosl 
.»n research now iul.iys is K-irif: i ;irru'<l mil within tlic Irami'work of iiiiitc liiffic ortiani/alinn.s In ni:iny ca.scs. rcscan-h projccf.s arc uiulcflakcri hy groups 
or ii-.uus of roscarUicrs «ho ha\c liiniiwl control ovit ttic rcsouni'S iJu-y use. ami cannot claim personal re,sp<)n.sit)ility for what is allcniptcil nr what 
IS ai tiK-s<-d In oilier words, ttie i-xiieine im/i w./uj/i tw cnibiulicd in the ;u.iuleniic ethtis is no longer coiisi.slent with the rcaJitics of scieiitinc life, where 
< ,■//«•( tiM- .iiiion IS no\s the rtilc On the other hand, the iiicorporatinn of iwadcmK science iriio an expandiiij; 'RAI)' system, drawint: funds frt)n) 
the central noscrnnieni and private industry |niean.s| academic science is losinp its place .is ;ui .luinnoinoiis swml sepment with its own standx Is 
.uul >!0.»ls. and is fx-iny hrou|chl under lolieciive" control Instead of l>einp irealc.i its an independent source of uiipraliciahle social inlluences. it h;is 
come to he rej!arde<l a.s an instrunieni of detib«-rale siKiet;il :ution " See John /inian, • C'ollectivi/ed Science." An IniroJinUon u> Svitme Stiulies 
(C'anibridge. l-,n>:larul Caint)rid>;e I'niversiiv (»ress. \^IM\, pp 1 ^V.^uote fn)ni pp 1 ^K H') 

•^Sce .NalioiMl Kese.uch l ouricil. /'if I nuiiirrnni: Keu\it>. h(',-nifr< lj:ulrr\ in < 'h,ini;f ( Wa.shinjiion, IK'.' National /Vudeni) Press. I^JK?) 
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that research careers attract good minds of eveiy 
iort--those that flourish in isolation, and those that 
thrive on interaction.^^ 

The trend toward larger research teams, more 
cooperation among individuals and groups, and 
more multiauthored papers is unmistakable.^ The 
question is whether large research groups will 
effectively duplicate or augment the mentorship 
function. Whatever the campus research setting, it 
must be valuable for the socialization of new Ph.D.s. 
The process of scientific research is learned in 
university settings, but sometimes the skills associ^ 
ated with the process (e.g., data handling and 
communication practices) do not transfer well to 
nonacademic settings.^ 

Other Considerations 

Federal research fiidinf serves various goals, 
none more important than the strengthening of 
education and human resources. The Federal Gov- 
ernment has a special role both as a primary catalyst 
of the future supply of Ph.D.s and as one employer 
of the existing Ph.D. work forced'' 

In addition to the issues outlined above, the 
Federal Government must also consider several 
questions. First, given the tendency of Federal 
fiinding to concentrate in a small set of universities, 
what efforts should be made to suj^rt other 
institutions? (Or is there an optimal mix?) Twenty 
percent of all authors of scientihc papers produce 80 
percent of the scientific literature.^' Furthermore, 



basic researchers are concentrated in a relatively 
small subset of all academic institutions* and con- 
ventional wisdom says that scientific productivity 
depends on the extraordinary achievements of rela- 
tively few researchers, laboratories, and universi- 
ties.'^ Writing in 1968 as a physicist and academic 
dean, as well as a policy advisor, Harvey Brooks put 
it this way: 

The vigor of a scientific field seems to depend on 
a umtinuing injection of new investigaton with 
fresh ideas and on sufficient fiinds to exploit new 
ideas. . . . Td spread the same funds more and more 
thinly over a growing number of investigaton, 
instinitions, and students would be a prescriptim for 
the slow strangulation of science in the United 
States.'" 

lb avert the "slow strangulation of science," a 
concentration of funding in select research institu- 
tions and research groups (which is what the Federal 
Government currently practices) would seem wise. 
However, at what point does concentration begin to 
dismpt the interdependence among researchers? Not 
funding a wide array of researchers risks curbing 
more than the flow of resources; it can interrupt the 
flow of communications and begin to deter coopera- 
tion between specialists. Such coq)eration, which 
contributes to the accumulation of research findings, 
is especially intense at universities.''^ Sustaining 
I^oductive researchers (and the students who will 
eventually join the top ranks of scientists and 
engineers) fiises Federal research funding policy 



•'Sidney Ptrkowltt. "Lirga MKhlaei Ait Breeding Uiger Researeb Ttuu," The Scltntitt, voL 3. Oct. 16. 1989, pp. 13, 15. 
•(Natioiul Scieoce Board, op. cil., fooioote 4, p, 120. 

''For « dlscuiiioa, lee Natlotul Academy of Sciencei. Comminee oo (be Cmidttcl of Scieace, On Being A Scientist (Wadiingtoo, DC: Nadonal 
Academy Presi. 1989), pp. 10-22. Alio tee Ibiy Shino. "ScieatiTK DiscipUnea and Organizational Spedfictly: The Social and Cognitive Conf^piration 
of Laboratory Activitiei," 5c/e/ir(/lc EttabtUhmtntt and Hierarchies, N. Eliai et al. (edi.) (Dordrecht, Holland: D. Reidel. 1982), pp. 239-264. 

Federal OovernmeiU empk)yi 200,(X)0 icientiiti and eogineen, about 1 1 petM^ 
oeitber have • Pb.D. no* do bench mearch, tbey m facUitatoriof reiearchpeifonnance (aa agency program maaagen). Mkroonnagefneat of the Meral 
toboratoriet. pertoonel cellingi, noncompetitive lalaxy, inadeciuate fringe beoeflta. ethici lawi, and the pablic image of Menl Mvicc tn reported to 
contribute poteatlaUy lo a Federal "brain diaia" Yet only 5 percent leave Federal employnKot amnally. See Janice Long, "Ageodea Con^te WtU 
in Scieoce Job Market," Chemical A Engineering Newt, vol. 68, No. 39, Sept. 24, 1990, p. 23. For further diacostion, aee Alan K. Campbell «id Linda 
S. Dlx (edi.). National Reacarch Council. Recruimuni. Retention, and UtiUiadon cf Federal ScitndM and Engineers (Waihingtoo. DC: NatioMl 
Academy Preaa, 1990). 

7ijoaa(han R. Cole and Stephen Cole. "Hw Ortega Hypotheil]." Sdence, vol. 178, Oct. 27, 1972, pp. 361-372. Alw we Sbttoa Levin and Paula 
E. Slephan, "Research Productivity Over the Life Cycle: Eviieoce for Academic ScieotiiU," American Economic Review, vol. 81, M«b 1991, pp. 
114-132. 

"See Ocne Byllniky, "Ameilca'i Hot Young ScktaiM." Fortune, vol. 122. No. 9. Oct. 8, 1990. pp. 56-69. Alio im David Peodlebury. "Science 
Leaden: Reteanben to Watch in the Ne«i Decade, ' ' The Scientist, vol. 4, Kfay 28, 1 990, pp. 1 8- 19, 22-24; and A.L. Ptotter et al ., • 'Ciutiooa and Scientific 
Frogreu: Comparing BibUomeuic Meaiurea With Scientiit JudgmeoU." Scientometrics, vol. 13, 1988, pp. 103-124. 

"Harvey Brooka, "The Future Growth of Academic Reieaich: Criteria and Needi," Science Policy and the University, Harold Orlani (ed.) 
(Waihiqgton, IX:: The BrooUngi Inititutioa 1968). pp. 75-76. 

'^Reaearcben form Informal networki according to their ipecialization in iddition to the formal organizadom in which ihey work. Il ii not known 
bow changes in funding pattemi tffut informal as opposed to formal commuoicayon. Sec Uth A. Lieviouw. "Four Rcsevch Programi in Scieotific 
Cofflmunicatioo." Knowledge inSociety, vol. 1. lununer 1988, pp. 6-22. 
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with trai&l*«. employment, and productivity con- 
cerns. 

A further aspect of concentration of fading, and 
one of mounting concern to universities and agen- 
cies alike, is the degree to which the Federal 
Government could promote participation in science 
by disadvantaged groups and by regions of the 
Nation that have not traditionally received large 
amounts of Federal research funds. Disadvantaged 
groups and potential scientists and engineers who 
are geographically dispersed in research are consid- 
ered by many to be untapped resources that could 
enhance U.S. research capacity. At present, set-aside 
programs help to accomplish these goals (see box 
7-F). A more concerted and sustained elffort by the 
Federal Government to increase participation is 
warranted in the coming decade. 

A final question is this: should the Federal 
Government focus its educational support on gradu- 
ate fellowships, traineeships, and research assistant- 
ships (regardless of the combination), or spend a 
larger proportion of funds on undergraduate educa- 
tion and earlier segments of the pipeline? If one 
believes the projections of future shortages in Ph.D.s 
for the 1990s, then the Federal Government could 
produce many more Fh.D.s for the short term to meet 
the need, and then reconsider the question. If there 
are concerns about the^c projections (as OTA has 
ascertained), then the Federal Government could 
take a long-term view and work to enhance the 
supply throughout the pipeline. This would particu- 
larly argue for a greater investment in undergraduate 
science and K-12 education. As labor economist 
Alan Fechter writes: 

The relevant policy issue should be whether the 
expected equilibration mechanisms triggered to 
correct . . . imbalances will be consistent with na- 
tional needs and more global social objectives — If 
not, then policymakers will need to consider other 
mechanisms that will equilibrate supply and demand 
with minimal unwanted side effects.''^ 

A key concern for the future of the research work 
force is not only the size of the pipeline, but the 
composition of the students in it. What is the relative 
proportion, especially at the doctoral level, of U.S. 
citizens and foreign nationals? The evidence pre- 
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A student In the Early Enlranoe Program at tha 
University of Washinoton parformt a physics txperimem. 
Sdenoo education from K-12 through undergraduate 
levels it vital for preparing the icionce and anginMring 
research work force. 

sented in this chapter cn the chronic underrepresen- 
tation of women, minorities, and the disabled among 
science and engineering Ph.D.s suggests that finan- 
cial support mechanisms have discouraged certain 
segments of the talent pool from pursuing graduate 
shidy. How can the Federal Government, through 
direct financial incentives and institutional pro- 
grams that can modify student aspirations, reverse 
this trend? The answers have implications not only 
for the size of the work force, but also for the 
character of the scientific work that new participa- 
tion automatically brings to the Nation's research 
enterprise.""* 



Conclusions 

The U.S. system of doctoral production has 
consistently displayed its excellence over the past 40 
years. The number of doctoral scientists and engi- 
neers employed in the United States has grown by 
almost 50 percent since 1977 Nevertheless, several 
trends in the production of new Ph.D.s are of 
concern. Many also question whether shortages in 
the future U.S. scientific and engineering work 
force, and particularly its research component, are 
inevitable. 



^^Pechler. op. cit.. footnote 26. p. 19. Also *ee List Simon. ' 'Oeiplte Scientist Shortife, Future Ph.D.s Vtu Joblecineu." The Scimist. vol. S. No. 
l.J«n. 7. 1991. pp. 24. 32. 

'"'fw eumple. lec Jcny Outon, ' 'Tbe BcneflU of Black Participation in Science, ' ' Blacks, Science, and American Education, Willie Pewion, Jr.. 
■ad H. Kenneth Bccbtel (eds.) (New Brunswick, NJ: Rutgers University Press. 1989). pp. 123-192. 
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Box Minority Biomedical Research Support Program 

As pan of the Nationai Institutes of Health^i (NIH) effort to promote involvement of minority scientists in 
ongoing research, the Minority Biomedical Research SupjXNt (MBRS) Ptogrun awards grants to institutions with 
substantial minority enroUments. The puipose of the program is to support research by American Indian, Black, 
Hispanic, Native Alaskan, Asian, and Native Pacific Islander faculty and studems in the biomedical sciences, and 
to strengthen the grantee institutions' biomedical leseaich capabilities.^ . 

Initiated in 1972, the MBRS Prognun was originally administered through the NIH Division of Reseaich 
Resources, but in 1989 was moved to the National Institute of General Medical Sciences (NIOMS). Two- and 
four-year colleges, universities, and health professional schools with either SO pereent or more minority student 
enrollment or those with a demonstrated commitment to the assistance of minority studenU and facuhy are eligible 
to apply for a project grant. Hie average annual grant is $350,000, the highest $1.5 miUion. MBRS Program gnmts 
may be used to support time for faculty members to oigage in reseaich; explmatoiy research and ftiU-scale reseaich 
activities through the purchase of equipment, supplies, and technical assistance: and undergraduate and graduate 
students woridng "hands on" in a faculty member's researeh. Figure 7F-1 shows the size and number of MBRS 
awards for the past 15 years. 

Figure 7F-1~MBRS Awards and Funding: Fiscal Years 1975-90 (in millions of 1082 dollars) 
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Project review and managcmeitt, including monitoring progress and negotiating budgets, are assumed by 
NIGMS. As a line item in the appropriation for NIGMS, the MBRS Program received over $28 milUon in fiscal 
year 1989. ITie program received an additional $1 1 million from other NIH components (which have contributed 

^Whai foUows ij based oa Naiioflul Imtitute of Oeneral Medical Scicaceii "Miaority Biomedical Research Support PrograoL** 
administrativedocument. April 1990. 



There are pitfalls in many of the methodologies 
emph)yed in projections: their track record is 
Itouhlesome. Most notably, OTA questions the 
ability of staiistical analyses to predict future 
demand for Ph.D.s. especially when coupled with 
uncertainty about levels of Federal and industrial 
support for s/e research in ihe 199{)s. Nevertheless. 



these trends should be monitored, and investments 
in the educational pipeline continued to ensure a 
robust supply of students. This is in the national 
interest, not jusl essential for science, engineering, 
and the research enterprise. For this reason alone, 
increasing the attention to teaching in research 
centers is warranted. 
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for the past 1 3 years) to help support MBRS letoaich projects of direct relevance to their own missloas* Pkesently, 
U other NIHcompoMoU and the Alco^ 

The MBRS Ptogram has two funding mechanisms. Hie first, the traditioaal MBRS Program, provides support 
of up to $1 .5 milliion per year for faculty members to carry out reseiuch projects, lb be eligible, ah institution must 
undertake at least 2 and no more than 25 research projects and mtist involve at least 2 ^KiUty members having 
different research interests. A heavy emphasis is placed on involvement of undergraduate and graduate students in 
faculty research projects. The hope is that from this interactive relationship, a commitment to science will develop, 
and biomedical research will become an attractive career option for those students. While ficulty members are 
expected to submit their woric for publication in peer<reviewed scientific journals, the program also expects sttKients 
to participate actively in the research, coauthor publications, attend scientific meetings, and give presentations. 

The second component of the MBRS Program, the Program for Undergraduate Colleges and Two-Year 
Colleges, began in 198S and suf^rts enrichment activities, pilot research projects, and regular research projects. 
The maximum award under this program is $450,000 in direct costs over 3 years, plus indirect costs. A portion of 
these award monies must be applied toward ^'enrichment activities,*' such as workshops, attendance at scientific 
meeiingSc and summer research experiences in off-campus laboratories. In addition to the two primary award 
programs, the MBRS Program started supplemental funding for both instrumentation and animal resource 
improvement in 1983 and 1987, respectively. 

Currently, institutions in 31 States are supported by the MBRS Program, with California and Puerto Rico 
having the most institutions participating in the program (nine and eight, respectively). Like many programs 
targeted to groups undeq)articipating in science, the MBRS Program re|msents a weil-insdmtionalized model that 
could be generalized if funding permitted. As a recruitment and retention device, the program couples students ic 
role models, previews science as a career, and builds instituticmal capability to compete for Federal funds and 
conduct collaborative, cutting^edge research. A significant number of awards are concenuated in southern States 
with large minority populatims, such as Alabama, Georgia, and Ibmtessee. Thus, the MBRS Program, in 
conjunction with the other NIH e^orts, is intended to produce a larger minority presence in the research wcvk force. 



While OTA has presented data on human re- 
sources in research, more detailed data could \k 
collected. F-or instance, it is at best possible only to 
estimate, with presently available data, the size of 
the research work force. Hased on the NSF estimates 
cited above, the U.S. s/e work force of academic 
Ph.D.s totals .^4{),()0(); those refH)rting resetu*ch as a 
primary or secondary work activity total LS3,(X)0. So 
less than one-half (about 45 percent) of those in the 
academic sector are engaged at all in research, but 
this represents an unknown fraction of the total 
research work force. Tlie proportions federally 
funded and the number of scientists and engineers 
leaving reseiu^ch ciueers are also unknown. i£ven less 
intormation exists on the evolution of research 
groups (and its effect on graduate training). Much 
anecdotal evidence and some |>ersonnel expenditure 
data from NIH and NSf' indicate that research 
groups are l>ocoming hi'-ger on average* yet the si/e 
of the distribution ;uui its rale of growth are 
unknown. (The next chapter reviews the stale ol ilata 
on the research system, antl presents suggesUons for 
enhanced datacolleclit)n in the Tetleral agencies luid 
elsewhere.) 



Ba.sed on the trend.s reviewed hce, OTA finds that 
there is no current cri.sis in the Nation's ability to do 
scientific resciu-ch. The Federal Government may 
wish to do nothing now to intervene in the Ph.D. 
production system iuid let market forces operate 
unencumbered. Federal funding will continue to 
serve the goal of excellence in research. If funding 
growth slows, however, the related goals of educa- 
tion and humiui resources risk becoming .second- 
order priorities. All miu^kets would be fortified by 
enhancing die education pipeline, especially at the 
undergraduate level, to ensure Uiat future shoitages 
cim be met. 

However, the compositit)n t)f siudents in the 
pipeline — by gender, race/ethnicily» and national- 
ity — is of greater conceni. The scientific community 
could benefit from the diversity of research interests 
and apprt)aches that new entrants bring, especially 
those from groups who have historically nt)t partici- 
pated fully in it. Tlie Federal Ciovernment may alst) 
wish to consider, through new legislation, more 
extensive and lt)ng-ienn support for the recruitment 
of potential scientists and engineers frt>ni groups 
di.sadvantaged within s/e, as noted above. A diver- 
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sity of personnel and career paths will distinguish 
the research work force of the 19908. 

Policies could be devised that target incentives for 
ilt labor markets disaggregated by field and sector. 
Research in many fields is moving toward a more 
''industrial" model, with larger teams, specialized 
responsibilities, and die sharing of infrastructure. In 
response, the Federal Government has acknowl- 
edged changes in the (sometimes interdisciplinary) 
composition and more complex structure of research 
groups through centers and block-grant fimding. 
Perhaps it should now provide the impetus for 
universities to examine and experiment with their 
policies concerning the opportunities and rewards 
for nonprincipal investigators, e.g., postdoctorates 
and nontenure track researchers. 



All policy initiatives will need to consider im- 
pacts on undergraduate and graduate teaching, the 
stress on the current academic model of research and 
education, and new models that might lessen institu- 
tional strain. Reauthorizaion of the Higher Educa- 
tion Act of 1965 by the 102d Congress will provide 
an opportunity to encourage universities to increase 
the rewards for undergraduate teaching and enhance 
undergraduate and graduate experience in diverse 
career paths. If diis chapter has demonstrated 
anything, it is that human resources are a main 
business of the Federal Government, and not a 
marginal concern in strengthening the Nation's 
scientific research capability. 
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The measurement process is also inherently limited by the inevitable human selection 
of both the phenomena to be measured and the type of data considered relevant to the 
purpose of the measurement effort. . . . For measuring an area as little understood as the 
science and technology enterprise, multiple models are needed to insure that as wide a 
spectrum of phenomena as possible is included. 

U.S. General Accounting Office^ 



Introduction 

While this report has characterized the Federal 
research system as it enters the 1990s« its mandate 
was broader. OTA was asked what data and analyti- 
cal tools would be useful in describing the research 
system. Preceding chapters have drawn on much 
data. However, there are many areas in which 
additional information would be welcome. Data, in 
short, are an issue in Federal research policy, 
especially their form, gaps, and uncertainties. For 
example, OTA has discussed: 

• variable defmitions of '"scientists" and ''engi* 
neers*' that can result in radically different 
estimates of their numbers (chapter 1); 

• problems with using different deflators to 
calculate constant dollar trends in research 
binding (chapter 2); 

• potential comparisons between congressionally 
earmarked and peer-reviewed projects (chapter 
3); 

• lack of information on how agencies process 
research proposals prior to awards (chapter 4); 

• problematic estimates of research expenditures 
in megaprojects (chapter 5); 

• need for comparative cost-accountability data, 
by institution and source, on research expendi* 
tures (chapter 6); and 

• lack of baseline information on the Nation's 
research work force, as opposed to all scientists 
and engineers (chapter 7). 

Data collected on certain aspects of the Federal 
research system — sources and dollars spent for 



research, academic degrees awarded, facilities and 
instruments, and various outcome measures such as 
publications and citations — are extensive. 

In other areas, however, data are scarce, for 
example, details on the research work force (as 
opposed to the total science and engineering work 
force), or what proportion of investigators — across 
fields and agencies — are supported by Federal 
funds. Also, compared to the Nationid Science 
Foundation (NSF) and the National Institutes of 
Health (NIH), the other research agencies devote 
few resources to internal data collection. Conse* 
quently , most analysis and research decisionmaking 
must draw conclusions from the NSF and NIH data 
systems. Since these agencies represent only part of 
the spectrum of research supported by the Federal 
Government, these analyses may omit key results 
and trends at other agencies, or skew findings toward 
biomedicine or academic research. 

Furthermore, it is not clear how available agency 
data are used to inform decisionmaking, as some 
challenge current policy assumptions and others are 
reported at inappropriate levels of aggregation. For 
example, while there is much attention paid to the 
rising cost of instrumentation and facilities, indirect 
and personnel costs are rising at faster rates and 
account for larger shares of Federal expenditures. In 
this case, the issue is not infomiation, but what can 
be done with it by decisionmakers.^ 

In this chapter, OTA Hrst summarizes the data that 
are currently available. Table 8-1 lists the new data 
that OTA gathered and examined for this report. 



*U.S. Ociwral Accounting Office, Saence Indicators: Improventenis Needed in Design, Construction, and Interpretationt PAD-79-35 (Wuhingtcm, 
IX:: 1979). pp. 5-6. 

diiltnction is made throughout this chapter between ''decitionmakcre'* and **policynukers.** The former comprise a considerably larger 
population, especially within the Federal research agencies; the laner are found at the very top of thoie agencies, as well as in the Office of Management 
and Budget, the Office of Science and Ibchnology Policy, and Congress. Data speak to research decisionmakers al all levels, some of whom are not 
responsible for policies. 
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9Ron Jotmaton, 1>rojact Salaotion Mathodi: mtamallonal Compariaona," OTA contractor raport, Juna 1 WO. 
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Second, OTA suggests additional infonnation that 
could be collected, concentrating in areas of policy 
relevance and on data that are amenable to manipula- 
tion in the aggregate by Congress and the executive 
branch (especially the Office of Science and Ibch- 
nology Policy (OSTP) and the Office of Manage- 
ment and Budget (0MB)), and at less aggregated 
program and project levels within the research 
agencies. The emphasis is on the analysis and 



presentation of data for monitoring changes in the 
Federal research system. Finally, OTA considers the 
utility of data for decisionmaking, revisiting the 
I^oblems of evaluating research projects (and updat- 
ing conclusions of a previous OTA study). 

Information is not cost-free. While it can illumi- 
nate the operation of the Federal research system, for 
all participants and at many levels, the puipose is not 
to generate needless paperwork and impose new 
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reporting requirements on the agencies. What may 
be ajjpropriate for decisionmakers, in fact, is less 
information, not more, along with better measures 
and methods of applying and coordinating it. 

What Data Are Available on the 
Federal Research System? 

Many organizations collect and analyze data on 
the research system. First and foremost, is NSF, with 
its numerous surveys, reports, and electronic data 
systems that are publicly available. Other sources 
include the other Federal research agencies; the 
National Research Council (NRC); the Congres- 
sional Research Service (CRS); professional socie- 
ties, especially the American Association for the 
Advancement of Science (AAAS); and other public 
and special interest groups.^ 

Ibgether these databases and aitalyses provide a 
wealth of information: time series on the funding of 
research and development (R&D); expenditures by 
R&D performer (e.g., universities and colleges, 
industry, Federal laboratories), by source of funds, 
and by type (basic, applied, development); numbers 
of students who enroll in and graduate wiUi degrees 
in science and engineering (s/e); characteristics of 
precoUege science and mathematics i^ograms and 
students in the education pipeline; and size, sectors 
of employment, and activities of the s/e work force 
(especially Ph.D.s in academia). Detailed analyses 
of the Federal budget by research agency are 
available each year, and impacts on specific disci- 
plines and industries can often be found. 

NSF publishes many annual or biennial reports. 
These reports summarize budget data from the 
Federal agencies, academic R&D (which is covered 
extensively, as academia is NSF's primary client), 
research at the Federal laboratories, fimding and 
performance of research by industry, academic 
equipment and instrumentation expen(titures, inter- 
national comparisons, geographic distributions of 
R&D funds, and other topics. NSF also publishes 
detailed information on students, degrees awarded, 
employment by sector, and the people who perform 
research. Finally, NSF issues many individual re- 




Photo owcft; N»ilotu/A0mnwtkm and S(m» AeMnkMon 

An astronaut spins liquid In swo gravity aboard th« Space 
Shuttia Columbia to fast th« separation of bubbles from the 
liquid. Research can take place In many different settbigs. 



ports on specific topics either requested by Congress 
or of particular interest to the scientific community. 

Certainly the most visible compendium of data on 
the research system is the biennial report. Science & 
Engineering Indicators (SEI), issued since 1973 by 
the National Science Board (NSB), the governing 



'For a iununaty of major daubaxes on acience and engineering (individual! and instituUoni), tee National Research Council, Engineering Personnel 
Data Needs/or the 1990s (Waahingion. DC: National Academy Presi. 1988). app. A.2. 
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body of NSP> At 1976 hearings^ NSB chairman 
Norman Hackennan traced the origins of SEI to a 
congressional mandate to NSB for its annual report, 
which was to focus on . , the status and health of 
science and its various disciplines (including) an 
assessment of such matters as national scientific 
resources, . . , progress in selected areas of basic 
scientific research, and an indication of those aspects 
of such progress which might be applied to the needs 
of American society."* From the outset, then, the 
SEI project aspired to measure and evaluate the 
results of federally supported R&D. 

Table 8-2 lists eight broad categories of data that 
have appeared in SEI, including impacts and assess- 
ments, resources, scientific performance, economic 
performance, international contacts, cross-sectoral 
linkages, literacy, educational pipeline, and scien- 
tific work force. Table 8-3 shows the distribution of 
tables among data types in the nine SEI reports. Even 
this broad-brush picture reveals a highly dynamic 
volume. Over the years, 79 distinct subcategories of 
data have appeared, ''bout one-half in the original 
1972 volume and about one-half added later. Tbe 
categories of international and cross-sectoral con- 
tact, literacy, and pipeline show steady patterns of 
expansion in types of data. Resources, impacts and 
assessments, and scientific perfonnance indicators 
have been stable, with some new types added. The 
economic performance indicators show high turn- 
over — many categories added and some dropped. 



Publication and citation measures are still the main 
fonns of scientific peifonnance data.'' 

SEI stands as the most comprehensive look at the 
research system that is cuirently available. Some 
find fault with the volume, however, because it is 
based on an input/output model of science (Le., 
"people and money enter the system, research 
comes out"), which is thought to be simplistic, 
omitting quantitative (and qualitative) measures of 
the process of research.* Others criticize SEI for its 
concentration on academic or academically based 
research and lack of emphasis on the research- 
technology interface.' 

Each year, CRS and AAAS publish perhaps the 
most comprehensive and widely read compilations 
of Federal R&D spending (the former focuses on 
appropriations, the latter on the proposed "R&D 
budget"), lliese documents help to interpret, by 
placing into an historical frame, the appropriations 
bills signed into law by the President. Mtrious 
professional societies, e.g., the American Chemical 
Society, also compile surveys of R&D spending, 
salaries, and employment opportunities that are of 
particular interest to their constimencies. In addi- 
tion, the American Council on Education, the 
Council of Graduate Schools, and the Association of 
American Universities publish annual and occa- 
sional reports that characterize trends in research 
university expenditures, administrator and faculty 



4The following discusilon of Science and Engineering Indicators (SPJ) it based on Suun B. Cozzcdi, "Science Indicaion: Description or 
Prescription?" OTA contractor report, July 1990. Available through the NaUonal "ftctaical Information Service, see app. P. Note that SBI was named 
Science Indicators until 1987. Science & Engineering Indicators builds on data collected, published, and issued in many other reports by the Science 
Resources Studies Division of the National Science Poundation. 

^The timing of these hearings was inportaot in the developfflent of the Indicators series. The 1972 volume had been assembled in the course of a 
few months by one staff person working with an enthusiastic and energetic Board committee. After a stormy and uncertain process of approval both within 
the Science Board itself (who could not agree on bow the numbers should be interpreted) and at the Offke of Management and Budget and the White 
House (who thought it presented administratioa policy in too unfavorable a light), the volume appeared amidst considerable fanfare in the science and 
genenU press (as reported by Robert Brainard. the National Science Foundation staff member who prepared the first report). See U.S. Congress, House 
Coromiilee on Science and Itehnotogy, Subcommittee on Domestic and International Scientific Planning and Analysis, Measuring and Evaluating 
Results of Federally Supported Research and Development: Science Output Indicatort—Pm I. Special Oversight Hearings, 94ih Cong., May 19 and 
26. 1976 (Washington. DC: U.S. Government Printing Office, 1976). 

*Ibid., p. 7. 

'The bibliometric databaiie bu added more to the categories of international and cross-sectoral contacts than it has to measures of scientific 
performance. 

*For oUter volumes thai addrrss these issues, see National Academy of Sciences, The Quality of Research in Science: Methods for Posiperformance 
Evaluation in the National Science Foundation (Washington. DC: National Academy Press. 1982): Y. Elkana el al.. Toward a Metric of Science (New 
York. NY: Wiley, 1977): and H. Zuckcmian and R.B. Miller (cds.). "Science Indicators: Implications for Research and Policy." Scientometrics, vol. 
2. October 1989, special issue, pp. 327-448. 

*Cozzens, op. cil., footnote 4. Because Science and Engineering Indicators (SEI) should refiect analytical advances in characterizing science and 
technology, provision could be made for the support of relevant research conununitics outside of (he National Science Poundation (NSF). According 
10 NSP's Carlos KruytboKh (personal communication, December 1990), at tiie very least "... biennial posl-publicaiion workshops to evaluate the SEI 
report arc workable and could be productive." 
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Tabl9 8-2~Catf gorif s of Data in Science A Engineering Indlcatore 



International eoniacta 

Cross-national citations and ooauthorihtps, publishing In foreign journals, participation in International scientific congresseSi 
employnnent plans of foreign students, U.S. students and academlce going abroad. 

Crou'$§etoral llnkagea 

Citations from patents to the scientific literature, cross-sectoral coauthorship, cross-sectoral citation, mobility between sectors, 
university patenting. 

Economie performance 

Patents, trade and trade balances, productivity measures, global Investments, Innovation Indicators, hlgh-technolo^v business 
sectoTi venture capital. 

/mpacf s anti a$s0$$nwnt$ 

Public views on allocation of resources for science, Judgments of benefit and harm from science and technology, prestige of 
scientists, expectations of scientific advances and problems caused by science, differences between the attentive and general 
ptjbllo. 

Literacy 

Enrollments In science arid nr^athematlcs, course content and testing requlrentents, achievement and test scores, teacher 
characteristics and activities, public understanding of scientific concepts, public use of technologies, student attitudes toward 
sdence and technology. 

Pipallna 

College end graduate school enrollments In science, engineering, and mathematics; degrses; test scores and other quality 
measures; preferences and plans of high school and college students; sources of student support. 
ftaaourcaa 

Expenditures and obligations, spodal research resources, instrumentation and facilities. 
Scientific performance 

Publication and citation counts, Nobel Prizes. 

Work force 

The sdenoe and engineering work force: comparative measures, demographic characteristics, career variables, sources of 
support, technicians, stock and flow analysis, 

SOURCE: Susen Cousns, "Scisnos Indicators: DeKriptlon or Pr«ioriptionr OTA contractor rsport. July 1990. 



issues, and Federal support for education and 
research. 

Recently, the Govemment-University-Industry 
Research Roundtable of the National Academy of 
Sciences, with data compiled by NSF's Policy 
Research and Analysif^ Division, provided much 
usefiil analysis on the state of academic R&D and 
changes since the early 1960s." In addition, NRC 
periodically publishes reports on sectors of the 
research system and on the availability of data to 
characterize the system. These publications pro- 



vide a basis for understanding the Federal research 
system. But even with each of these organizations 
devoting significant resources to the collection of 
information, better data are needed to guide possible 
improvements of the system.^^ 

What Data Are Needed? 

Recognizing that data collection is often very 
difficult, and certainly time consuming, OTA con- 
centrated on notable gaps in die empirical baseline. 
One overarching problem is that comparable data 



^^A monihly compcnoiura Uut timouncci «nd annouici Dew reports conuining dau and analysis on trends In icieoce and engineering U Manpower 
Commtnts, published by the Conunission on Professionals in Science and Tkclmology, a panicipaUng organization of (he American Associaiion for ihe 
.VivaJKement of Science. 

"Govitnmeni-Univcriily-lndustiy Research Roundtable. Science and Technology in the Academic Enterprise: Status, Trends, and issues 
(Washington, DC: National Academy Press. October 1989). 

>^For example, see National Research Council. Surveying the Nation's Scientists and Engineers: A Data System for the 1990s (Washington, DC* 
National A4:ademy Press, 1990). Under muJtiagcncy support, the National Research Council collects, analyzes, and disseminates informaUon on Ph.D! 
recipients. For a tlatenjcnt of lu cross-cutting role, see National Academy of Sciences. The National Research Council: A Uniaue Institution 
(Washington, DC: National Academy Press. 1990). 

^^'iTwic cfforu must also be seen in the context of Uic massive Federal dau syitero. The componenU most relevant to research arc tlic dau series 
compiled and reported by the Census Bureau, tfic Bureau of Economic Analy$U. the Bureau of Ubor Statistics, and the Natioaal Center for Education 
Statistics. The point is iUustraied by caUs for ways to measure how many people who wplre to attend college actually enroll. In the words of one 
sociologist: ' We care to know on a month-to-roonih basU what the unemployment rite U. I think we ought to care to know ou at least a year-to-year 
basis what the rate of access to higher education is." Quoted in mmas J. DeLoughry, "U.S. Asked to Set Student-Aid Ck)als for Ptoor and Minority 
Sludems." The Chronicle of Higher Education, vol. 37. No. 20. Ian. .10. 1991 , p. A20. 
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TabI* a^Titndt In Distribution of Dita Among Cattoorlot In Science A Engineering Indleetore: 1972-88 

NumbtroftabiM 



1072 



1874 1976 1078 1980 1982 1984 1986 



1;.>;-3 



Totil 



RMOumt 38 83 S7 

^ferot 18 37 35 

Eoonomio pirferrranoe 9 31 47 

ImpaotiandasMitmtnts 21 14 21 

PipdlM 23 ia 9 

Uteracy i 0 0 

8oienti(loperforminee 2 10 11 

International oonts'jia 0 2 8 

Cro«9«Mioral contacts 0 3 0 

fwnindleatori 0 0 0 

Total 112 173 188 



68 

35 
22 

a 

3 
0 
10 
10 
3 
0 

141 



41 
54 

40 
39 
1 
1 
11 
11 
8 
1 

207 



52 
37 
3?' 
35 
14 
4 
15 
11 
7 
1 

213 



49 

P« 
20 
19 
22 
14 
7 
11 
6 
1 

178 



47 

35 
29 
29 
46 
4 
9 
12 
0 

249 



Percant of total 



1972 1974 1976 1978 1980 1982 1984 

Ratouroaa 34 36 30 41 20 24 iT" 

Wbrfcforoa 16 21 19 25 26 17 16 

Eoonomio parformanoa 8 18 25 16 19 17 11 

ImpaoUandaaaaMnwnta 19 8 11 0 10 16 11 

Plpaima 21 8 5 2 0 7 12 

Utaraoy 1 0 0 0 0 2 8 

Soiantifieparformanca 2 6 6 7 5 7 4 

mtarnationaloontacta 0 1 4 7 5 5 6 

Croaa^MOloraloontacU 0 2 0 2 4 3 3 

Nonlndlcatora 0 0 0 0 0 0 1 

Ibtal 100 100 100 100 100 100 100 

NOTE: Each tabt*. text, or ippwdix It oounttd ono*. 

SOURCE: Suwn CotzMt, "Sci«not IndlOMtort: OMcrlptlon or PrMoitptlonr' OTA oonUaetor raporl, Juiy 1990. 



60 
30 
45 
18 
26 
54 
7 
8 
7 
3 

268 



46« 
313 
288 
198 
140 
120 
77 
70 
46 
6 

1719 



1986 1088 Total 



10 
15 
14 
12 
12 
18 
2 
4 
5 
0 

100 



23 
12 
17 
7 

10 
21 
3 
3 
3 
1 

100 



27 
18 
17 
11 
8 
7 
4 
4 
3 
0 

100 



associated with the research operations of all the 
Federal agencies are lacking. NSF and NIH con- 
scientiously log data on what proportion of propos- 
als sulmiitted to them are awarded funding, the 
number of researchers they support, expenditures by 
categories of project budgets (e.g., indirect costs and 
personnel), and other dimensions related to manage- 
ment of their research programs. However, other 
agencies collect only R&D budgetary information, 
primarily in response to 0MB requests and NSF 
surveys of research conduct. Much more data could 
be collected on research funding and performance in 
these agencies. In particular, further information 
could be collected on proposal submissions as well 
as awards, research expenditures by line items of the 
budget (requested and expended), and the size and 
distribution of the research work force that is 



suppciied. Comparable data from the agencies are 
important for decisions that span agencies or broad 
segments of the scientific community. With the data 
thi^ are currently available, C<mi^ss and other 
Federal policymakers risk overgener^izing from 
what is known about research performance that is 
supported by NSF or NIH. 

Some advocate that NSF should be the sole 
agency to centralize and standardize the analysis, 
especially since NSF has the mandate to collect 
R&D funding data from the other research agen- 
cies.'^ However, OTA found that the research 
agencies are sufBciently diverse in their organiza- 
tion and funding structures to create difficulties fot 
any outside agency to transkue data in comparable 
ways.*' For exan^le, breakdowns of R&D into basic 
research, applied research, and development are 



I4s«e Commluloa oa Prrfoulonili in Scioice ind Ibcfaaology, hteaairint National Netdifi>r Scientists to the Year 2000, itpott of • woikibop, Nov. 
30-Dm. I. 1988 (WuhlQitoo. IX:: July 1989). 

>*Altiw«|bprobtaiumsye]ilitwiifa dcflnHtoM. compliance by the repoftiogoci«niMitoniwift^^ 
ilvMme of m k»lwn«iicy nwch t n li m . lucb u tbt Office S^mc« mi Tfecfanohny PoUcy '« Mtrti Co o r di iwrtn t Cowacil for Sctenc*, B a gtaae riaa . 
and Ibclaology (FCCSBT) coomittoM. i* itt place in the Federal hierarcby: ibe a|cnciet are likely lo be reapoaeWe to reqacata for "crotacuttiot" 
informatioa where bodgM are al itake. the FCCSBT Coouninee on FhyilMl. Matbeoutical. and Enfineerinf Scieocea. for example, cwimtly haa a 
"ttncnoe of Kicnoe" activity diat iDclndei tbe wlicitotioa of daU from ibe reacaicb afeacies limllar lo thoie toufbl ia diia OTK itody. 
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very difficult to measure and often judgments are 
made afier-the-facL NSF fields a survey to all 
Federal RftD agencies asking for detailed estimates 
of ending in various categories. Because of 
problems with applying definitions and with con- 
verting agency accounting of research dollars into 
the separate categories, however, many of the 
agencies claim that it is impossible to provide 
accurate answers to the NSF survey. 

In 1989, NSF continued its effort to develop a 
better taxonomy of the research it funds. "Funda- 
mental," "directed," and "development" seemed 
to be the preferred categories, though some pro- 
grams found it difficult to translate currently sup- 
ported projects into these three categories. Unfortu- 
nately, any taxonomy would suffer from arbitrary 
divisions of research topics among categories. Also, 
"basic" and "applied," or similar definitions, are 
rarely used by managers to allocate monies; rather 
these distinctions are most in^xmant to the research- 
ers who perform the research, since basic research is 
synonymous with enhanced investigator discretion 
over research directions, while applied research is 
often associated with the attainment of specific 
objectives. Consequently, basic and applied divi- 
sions are less important for decisions that concern 
specific programmatic goals; however, they are 
quite important to decisions about the science base 
supported by the Federal Government. 

Enhanced data collection at each agency would 
help NSF fulfill its data mandate, and advance 
develojnnent of comprehensive research strategies, 
especially programs that span agencies. Other data 
that could be veiy useful fall into four categories: 1) 
research monies — how they are allocated and spent; 
2) personnel — characteristics of the research work 



force; 3) the research process->how researchers 
spend their time and their needs (e.g.. equipment and 
communication) for the conduct of research; and 4) 
outcomes— 4he results of research. 

Research Monies 

While the data collected on research sponsored by 
the Federal Government are abundant, information 
on research expenditures is not. In particular, direct 
and indirect costs in aU sectors of the research 
system supported by the Federal Government could 
be monitored." NSF and NIH have collected 
longitudinal data on research expendihires in indi- 
vidual investigator grants, but conq)lementary data 
are needed on expenditures in Federal and industrial 
laboratories, research supported by other agencies, 
and on other types of research groups and coopera- 
tive ventures such as centers and university-industry 
collaborations. These data would help to monitor 
fluctuations in research expenditures. At present, 
predictions of future spending merely eTftrapolate 
from the gross totals disaggregated by sector, while 
individual components of the budgets may be 
increasing or decreasing relative to overall trends. 
These data would be especially helpfiil for revising 
estimates of start-up and operating costs in science 
megq>rojects. 

Another measure that would refine the knowledge 
of research expenditures would be breakdowns by 
field. (This is available for some academic research 
disciplines and Federally Funded Research and 
Development Centers only.) Many claims are made 
about the cost requirements of specific fields. For 
instance, research in some physics specialties is 
inherently more expensive than in others, because of 
the equipment required by research groups. At 



MNSPlkik Force on Reiearch ud Developtneol DHonomy, ' 'Pinil Report.' ' uopubliihed docunwat, 1 989. For tnevUer effoit. utt Natiooal Scieoce 
Foundarion. Caiegoriet of Scientific Ruearch (WuhJngtoo, DC: 1979). 

■ ^S«e Harvey Avoch, ' 'The PoUtlcal Ecoootny of RAD IVuiooomiei, ' ' Rtuarch Policy, f oitbcooing 1 99 1 ; and Richard R. Riei aod Henry Hertzfeld, 
'"Duoootny of Reiearcb: Ifcit of PropoKd Defloitioaa oo the NSF Bud|et," nopubUihed document, n.d. 

i*For euople, the Nttiooal lostllvtei of Hetlth Ktt aiide 1 petceot of Ui reaearch budget for reaeaich evaluation aod tnieina] analyili of the 
invecligatora and profnou It Mpport*. The DepaiHoent of Energy, the National Aetonaotlci and Space Adminialradon, the Ofltlce of Naval Reaeaich, 
and die National Science Foundation have all conducted ad hoc tabouie evaluatlont of the reMarch they nppoft and the effkieocy <a the operatlooi 
needed to leleci and manage varloui leieaich portfoUoi (tee below). For an enample of agency-based reaeaich evahution data that could be aMembted 
In an ongoing way. lee Daryl B. Chubiu, "Designing Research Program Evaluations: A Science Studies Approach," Scitnct and fublic Policy, vol. 
14. No. 2, April 1987, pp. 82-90. 

"This monitoring Is not the tame «s the audiUog of cost d^ by category of wpeodituit. as mandated by Office of Managemem and Budget Circular 
A-21 and as conducted by the Depaitmeni of Defense and the Department of Health and Human Services contract audit agencies. That Is done for 
accoontabtiity purposes. Cdngress seeks better informatloo on how iavestlgatots and tbek teams actually spend money in the coone of eiecuting 
federally funded research projecu, which requires tome demyttilicatioo of university accounting schemes. For examples of studies of data aodit 
methodologies, see the new quuteily journal. Accouiuability in Research: PoUciet and Quality Atnirance. edited at the Uolvenlly of Mai>laod School 
ofMcdiciiw. 
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present, theie are no means to evaluate these 
claims.^ Yet for decisions that must balance (he 
present and future needs of different sectors of the 
research system, such cost estimates and the trends 
associated with them could be very important. 

Finally, data on how Federal agencies allocate 
monies within project budgets could be compiled. 
Agencies have much experience in negotiating 
budgets. Data would illuminate how judgments are 
made about specific categories of expenditure, e.g., 
in reducing inflated' ' budget requests of investiga 
tors, imposing an artificial ceiling on equiinnent 
purchases, or adjusting allocations through NlH's 
practice of "downward negotiation." Since person- 
nel costs have grown quickly compared with other 
research expenditures, financial analyses would be 
greatly enhanced by better personnel data. 

Personnel 

One of the most fundamental pieces of informa- 
tion on the research system is the size of the research 
work force, both in absolute numbers and as a 
fraction of all U.S. employed scientists and engi- 
neers. These numbers depend on how "researcher" 
is defmed.2^ While estimates exist of the rise in 
Ph.D. personnel employed in research universities, 
very little detailed data exist for industry or other 
sectors of the research system. Estimates of the 
positions held by Ph.D. personnel in academia are 
inadequate. Distinguishing nonfaculty research as- 
sociates from postdoctoral fellows and full-time 
equivalent faculty is analytically important — and a 
nightmare to sort and track over time. Accuiate 
estimates of the changing size of the research work 
force and how many are federally funded — and are 
seeking such support — would aid in measuring 
current and unfunded academic research capacity. In 
addition, accurate estimates of the numbers of 
researchers exiting the system would help to gauge 



the attractiveness of specific fields, as well as the 
category "science and engineering" relative to 
other occupations.^ 

Another trend that has been noted in this report, 
mostly with anecdotal evidence and inferences from 
analyses of expenditures, is the increasing size of 
research groups, both within the university structure 
and through Federal support of centers. This trend 
has policy implications for the cost of research, its 
interdisciplinary c^abilities, and the changing dem- 
ographics of the work force. It also reflects how 
researchers may spend their time. More data on 
"production units" in research and their depen- 
dence on Federal funding relative to other sources 
would augment enroUment, Ph.D. award, and work 
activity data. Changes in the struchu-e of production 
units have also influenced the research process and 
the volume— and perhaps the character— of out- 



comes 
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Research Process 

"How research is done" has evolved since the 
1960s. In particular, the organization of research 
groups and the settings in which research is con- 
ducted ^lave changed.^ Data on the conduct of 
research would aid in understanding the opportuni- 
ties and stresses on the Federal research system and 
in planning how the research system can adapt to 
changing conditions. 

For instance, it is often claimed that researchers 
are spending much more time writing proposals, and 
that their research suffers as a consequence. No 
systematic data exist either to support or refute this 
claim. While it is in the interest of Federal sponsors 
for their grantees to spend as much time as possible 
in the conduct of research, investigators report that 
the increased competition for Federal funds compels 
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30For a rcocni effort lo look comprehensively at Federal support. \yy agency and over lime, of one lector of one field. %cc American Chemical Sock^, 
Department of Government Rclationi and Science Policy, Federal funding of Academic Chemistry Research. FY mO-FY 198S (Washington, DC: 
November 1990). 

2iA • 'reieaf Cher" could be defined as anyone publishing a scientific paper (I.e., by authonWp), possessing a Ph.D. (I.e.. by credential), or working 
in a particular setting (i.e., by sector). Indeed, the problem of defining who is a "scientist** also applies here. Sec Dmk de SoUa Price, Unit Science. 
Big Science (New York, NY: Columbia University Press, 1963). Also see National Research Council, op. cit., footnote 3. 

»For a discussion of methodological pitfalls associated with assessing, for example, characteristics of the Federal work force, see U.S. General 
Accouniing Office. Federal Work Force: A Framework for Studying lis Quality Over Time, GAO/PEMD-88-27 (Washington, DC: August 1988), 

^The role of laboratory chief or team leader combines entreprcnairial and administrativc/fupcrvisory tasks. Both arc essential to the funding and 
longevity of the productive research unit. On the emergence of the entrepreneurial role on campus, see Henry Etzkowitz, ••Entrepreneurial Scientists 
and Entrepreneurial Universities in American Academic .Science/' Minerva, vol. 21. summer-aummn 1983, pp. 198-233. 

2*For a prophetic discussion, sec B.C. Griffith and N.C. MulUns, ' •Coherent Social Groups in Scientific Change,** Science, vol. 177, Sept. 15. 1 972, 
pp. 959-964. 
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Photo cndH: U.S. Dtprntntnl otAgrieuHur* 



Researcher plck$ Uueberrles— OS peroem of the varieties 
of l)luei}errles In production today were developed by 
Department of Agriculture scientists. Research Is 
performed In many settings. 

proposal writing.^^ However, one might expect that 
as the size' of academic research groups grows, 
principal investigators will spend more time seeking 
money to sustain their larger research teams and 
programs.^^ This phenomenon is similar to strate- 



gies in a law or consulting practice, where the 
addition of less senior associates leverages the effort 
of the more senior employees to spend more time 
marketing and winning projects for the firm. In the 
academic research community, entrepreneurial pur- 
suits are very different from research and teaching, 
and the additional burden can be a source of stress 
for senior researchers.^^ 

Many also claim that increasing time commit- 
ments required by research pursuits hamper the 
ability of faculty to meet their teaching responsibili- 
ties. Data on how faculty a]^rtion their time have 
been unreliable. Ironically, self-reports in compli- 
ance with Federal accountability requirements tend 
to distort estimates of time spent on various work 
activities.^ Since the Federal Government invests in 
the academic research system to maintain a strong 
instructional as well as knowledge-producing capa- 
bility, shifts in the activities of researchers is of 
central concern. 

Data are needed on how apprentice, junior (e.g., 
postdoctorates), and senior researchers spend their 
time on research (collecting data and analysis), 
proposal writing, teaching (classroom and one-on- 
one), travel, presenting results to scientific col- 
leagues, and other pursuits.^ Differences between 
time commitments in Federal, industrial, and aca- 
demic settings could also be judged.^ 

More generally, data could be collected on 
changing equipment needs. The average lifetime of 
a scientific instrument has shrunk during the 1980s 
from an average of 7 years to less than 5 years.^* 
Additional data could address such questions as: 
how does the reliance on equipment vaiy across 
fields? What happens to obsolete equipment? As 



^For example, tet Science: The End of the Frontier? a report from Leon M. Ledemian, PrealdeoJ-Elect lo the Board of Dlitctoni of tt» .American 
Aisociatioa for ihe Advancemeol of Science (Washington. DC: AmeriCin Auoctation for (be Advancemcm of Science, January 1991). 

^Sec D.E. Chubin and T. Connolly, "Research Trails and Science Policies: Local and Extra-Local Negotialioos of Scientifk Work," Scientific 
Establishments and Hierarchies, Sociology of the Sciences, Yeartmok vol. 6, N. Elias (ed.) (Dordrecht, Holland: D. Reidel, 1982), pp. 293-31 1 . 

"For evidence on entrepreneurial txhavior. see Karen Seashore Louis el al., ' 'Entrepreneun in Academe: An Explontion of Behaviors Among Life 
Scimisls," Administrative Science Quarterly, vol. 34, 1989, pp. 110-131, 

^Set Donald Kennedy, "Ciovemmem Policies and the CosU of Doing Research," Science, vol, 227, Feb. 1, 1985. pp. 480484. 

^or example, dau could illuminate changing patterns of communication among scientific colleagues. With new communications teclmologiei, such 
as electronic mail systems and computer netwoHcs, scientists have the ability to exchange data and ideas much more often. Is science becoming more 
colliborative (or competitive) due to these innovatioos? Do most scientists have access to these technologies? Are some at a disadvantage without them? 

^Some clues derive from in situ laboratory studies of scientists, for example, Bnmo Latour and Steve Woolgar, Laboratory Life: The Social 
Construction of Scientific Faat (Beverly Hills, CA: Sage, 1979); and Bruno Latour, Science in Action: HowTo Follow Scientists and Engineers Through 
Society (Cambridge, MA: Harvard University Press, 1987). 

"See National Science Foundation, Academic Resemch Equipment in Select Science/Engineering Fields: 1982-83 to 1985-86, SRS 88-DI 
(Washington, DC: June 1988). As the National Science Foundation's Leonard Ledennan (personal comrounicatioo. December 1990) points out, there 
is 00 information of average ' 'equipment use rate," or what proportion of available time an instiument is in use. 
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communications and other technologies progress 
and the scientific community comes more to rely on 
them, these questions will increasingly impact 
Federal fimding. 

A final area of ' 'process' ' on which data would be 
instructive are the standards for achieving various 
positions in the scientific community. Many claim 
that graduate students must publish more papers to 
be offered furst jobs after receipt of the doctorate or 
completion of a postdoctoral fellowship. What are 
the average age, experience postcollege (in years), 
and publication records of new hires at research 
universities, and industrial and Federal laboratories? 
For other promotions? Such data would help the 
Federal Government to track the changing research 
labor market.^^ 

Outcomes of Research 

Because of the fundamental and elusive nature of 
research, measuring its outcomes — in knowledge 
and education — is veiy difficult.^^ Hie most elusive 
outcome is cultural enrichment — the discovery and 
growth of scientific knowledge. As 0MB Director 
Richard Darman has said (speaking of the proposed 
Moon/Mars mission): "No one can put a price on 
uplifting the Nation. ' ' Research has resulted in many 
benefits to the Nation and is funded precisely 
because of those benefits. This kind of benefit is 
nearly impossible to measure. However, there are 
some proxies. 

When looking at research as a contribution to 
education, numbers of degrees can be tallied and 
asseriions about skills added to the Nation's work 
force can be made. When looking at research as 



creating new knowledge, one tangible "output" is 
papers published by scientific investigators to com- 
municate new information to their scientific peers. 
Communicating the results of scientific research to 
colleagues throu^ publication in the open literature 
is considered to be an inqxntant, if not essential, 
feature of good research practice.^ Perhaps the best 
apptoich is to construct workable indicators and 
include a rigorous treatment of their uncertainties. 

Bibh'ometrics 

One tool that has been vigorously developed 
(especially in western Europe during the 1980s) for 
measuring the outcomes of research is bibliometrics, 
the statistical analysis of scientific publications and 
their attributes. Intrinsic to scientific publication is 
the referencing of earlier published work on which 
the current woric is presuniably based or has utilized 
in some way. References are a common feature of 
the scientific literature/and by counting how often 
publications are cite4< bibliometrics can arrive at a 
weighted measuiiB^ publication output — not only 
whether publications have been produced, but also 
what impact those publications have had on the work 
of other scientists.^^ 

OTA has explored several examples of new data 
sets that could be compiled using bibliometrics.^ 
First, universities can be ranked according to an 
output or citation measure, the citation rates for 
papers authored by faculty and others associated 
with each instimtion. OTA drew on the large 
electronic database created and maintained by the 
Institute for Scientific Information (IS\)V Each 
institution in ISI's Science Indicators database, 1973 
to 1988, was listed by its total number of cited 
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3^or oUmt suggextioQi, lee CommlMkM) on Profesitooals io Scicocc tad Ibchootofy, op. clt footnoce U. Tbe above (Itypocbetical) data «lso miie 
the queiUoD of research oulcomet— ihoM reUtiai to iodividoil perfonnaoce and that of other productioo units in the Federal research system. 

^^For a cocnpcebensive review (do w a decade old) of attempa at such measitrenieDt, see National Academy of Sciences, op. cit., footnote 8, cqvecialty 

ch. 2. 

^Robert K. Mertoiu ' *Tho Matthew Effect in Science. 11: Cumulative Advantage and Ihe Symbolism of Intellectual Property.* * tsis. vol. 79, No. 299. 
1988, pp. 606^23. 

'^Interpreting ciution patterns remains a subject of contention. For caveau. see D.O. Edge. * 'Qoaotitatlve Mea sur es of Communication In Science: 
A Critical Review.** Hiiforycf Science, vol. 17. 1979. pp. 1U2-1 34; and SM. Coaeos. **lttlng the Measure of Science: A Review of Citation Ibeoriea,'* 
ISSK Newiletttr. No. 7» 1981» pp. 16-21. The definitive overview is contained in Eugene Otrteld. Ciiation Indexing: Its Theory and Applkeuion in 
Science, Technology and Hmanitiee (New York. NY: John WUey ft Sons» 1979). Also see F^is Narln. Bvaluatiye BibUometria: The Vee of Citation 
Analysis in ihe Eyalmtion of Scientific Activity (Cherry Hill. Nl: Computer Horlions, Inc.. 1976). 

^See Henry Small and David Pendlebury. '*Fedml Support of Leading Edge Research: Report on a Method for identifying Innovative Aitas of 
Scientific Research and Their Extent of Federal Support.* * OTA contractor report. February 1989; and Hemy Small. **BibUometrics of Basic Rctearch»* * 
OTA contractor report. September 1990. For OTA CAXitractor reports available throo^ the National Ibchnical Information Service, see app. P. 

^^The Institute for Scientific Informatioo OSI) database coven 7.500ioureals published worldwide and indexes 8(X).0(X) new articles each year. The 
files derived from the ISI databases cover multiple disciplines and countries, and extend back to 1973. The analysis below is baaed on Small, op. dt. 
footnote 36. Tbe Science Indicators File is a specially constructed muHiyear file of pubiicatioas from ISrs Science Citation Index, which contains a 
citation count time series for each paper in the file that has been cited one or more times for die yean 1973 tlvougb 1988 inclusive. 
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Tabl« S-4-Mltmatch«t In Rank BttwMn Ptdtral Funding and Avaraga Citatlona: 1988 



Of the top 100 (107) federally funded universities, only 1 7 did not 
nuke the top 100 dtatlon list. They are (with funding rank In 
parentheses): 

11ixasA&M(22) 

University of FHorida (45) 

Woods Hole Ooeanographic Institute (52) 

ftow Mexico State University (61 ) 

iMlsiana State University (72) 

Utah State University (74) 

North Carolina State at Raleigh (75) 

Virginia Polytechnic institute and State University (76) 

University of Kentucky (82) 
. University of Dayton (86) 

University of Nebraska at Uncoln (89) 

Wake Forest University (95) 

University of Medicine and ITentistry of New Jersey (99) 
Washington State University (100) 
University of Missouri, Columbia (101) 
Medteal Collego of Wisconsin (104) 
Rensselaer Polytechnte Institute (107) 



Of the top 100 cited schools, only 17 did not make the top 100 
(107) most funded schools. They are (with dtatkm rank in 
parentheses)! 

University of California, Santa Cmz (14) 
University of Oregon (23) 
SUNY, Albany (43) 
Rice University (56) 
University of California. Riverside (59) 
St Louis University (70) 
Crelghton University (60) 
University of Notre Dame (61) 
Unhrerslty of Houston (62) 
University of New Hampshire (84) 
Unhwsity of Alaska (89) 
University of South Alabama (90) 
College of WIHIam and Mary (93) 
Howard University (04) 
BHgham Young University (96) 
University of Delaware (97) 
University of Oklahoma (98) 



NOTE: Tooompar*th«lop 100rankinst,iom«fnstitu<iont In the top 100 ftdmllyfundMl unlveraitlM were dlMggrtgated by campus of th« Stat* univwsity 

•yitam, eg., th« Univarslty of Tmm, Auttln. Thia eckM 7 •ntriaa to tha top 100. 
SOURCES: National Sciwtoa Foundation, Aeadtmk) Sohnet/Enghmring: MD Fund$, Ffteal Vaar f OM. NSF 89-326 (VMwhIngton, DC: 1000), tabia B-37: 
and Hanry Small, 'Bibllomatrioa of Baaic Raaaareh," OTA contractor raporl, ,^ly 1M0. 



papers, the total citations received by all papers 
associated with each institution, and the ratio of 
number of citations to the number of publications, 
namely, the average citations per cited paper. This 
is a more discerning measure than either publication 
or citation counts alone. A ranking of institutions by 
average citation rates can be used in conjunction 
with the list of top universities in Federal R&D 
funding received to link inputs with outputs. (Ap- 
pendix E lists the top 100 academic institutions 
ranked by their average citation impact for the period 
1981 to 1988.) Table 8-4 Usts the institutions, in 
1988, that were among either the top 100 academic 
institutions in average citations or the top 100 
receiving Federal R&D fiinds (again, see appendix 
B). but not both. Together, these measures illumi- 
nate differences in rank. The overlap in institutions 
suggests that the funding decisions by the Federal 
Government for the most part are leading to produc- 
tive research. The mismatches may be indicative 
both of concentrated, rather than broad-based re- 
search productivity, and either some institutional 
"overachievement" or a substantial supplementa- 



tion of Federal research support by State, corporate, 
and nonprofit sources.^^ 

Trends in the average citation rate over time can 
also indicate how productive an institution has been 
in the published literature. The citation set can be 
analyzed by broad field or other variables to try to 
determine the cause of the changes (see box 8-A for 
profiles of four universities). Institutions can also be 
grouped to look at how, for example, "private 
institutions in the Southwest" or the national labora- 
tories are performing as a categoiy^' (see figure 8- 1 ). 
Many companies and other types of research organi- 
zations, despite proprietaiy inhibitions, also publish 
in the scientific literature and their woik can be 
similarly aggregated and displayed^ (see figure 
8-2). In another example for future exploration, 
programs receiving primarily directed funds or 
block grants (e.g., in agriculture) could be compared 
with those that are investigator-initiated. This com- 
parison would help to test the claim that targeted 
appropriations (e.g., earmarking) lead to the produc- 
tion of inferior research. 



^Ao initltution that ranks high ou fiuxUag and low on cltadon impact ii not necessarily an undenctiiever. Some research is not leadUy published io 
the open literature, for proprietary or national security reasons. 

"For example, the publication records and ciution impact of National Aeronautics and Space Administration research centen, 1973 to 1988, ai« 
examined in ' 'NA.SA's Citation Unpad Dims in 1980a, But Voyager Missions and JPL Shine," Science Watch, vol. 1, No. 9, October 1990. pp, 1-2, 
7-8. 

^^Biotechnology research is more often reported in the open literature than either research from electronics and computing firms or ftom Fortune 500 
companies. Thus, the samples used in figure 8-2 may not represent the full range of research activity in these industries. Indeed, the most exciliai rrsulU 
may be withheld from publicatkw, but might be reflected in pateou awarded lata. 
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Box 8-A—Bibliometric Profiles of Four Research Institutions 

OTA selected 19 institutions, based on historical patterns in tlieir Federal funding profiles, to examine changes 
in research output and probe how they might be accounted for biblionietrically.^ The institutions' publication jind 
citation records were extracte<l to obtain a ''citation impact" time series. Tliis requires specifying four time points: 
a beginning iuid ending cited item period, and a beginning aiid ending t itm^ item time period. 'Iliis defines what 
items are eligible to receive citations and what journal publications are eligible to give them. OTA began with 1973, 
and defined the length of the period for analysis to be 8 years, Tliis yields nine successive overlapping time windows 
lluit can be plotted as a time series or moving picture of the citation impact for wich institution through 1988, 

For example, counted in the first window were the number of cited papers published from 1973 through 1980 
and the mimbcr of times those papers were cited by papers publi.shed in the same period. The ratio of these quantities 
is the mean citations per cited item for that time window. As a further normalization, each of the impacts is divided 
by the overall average for all U.S. pa^xjrs for the specified time window. e,g,, 1973 to 1980. ITie result is a tneasure 
of rvladve impact. Thus, a relative impact score of one signifies that the institution's average is identical to the 
average for all U S. pa|x;rs in the window. A score greater tluui one signifies an impact above tiie U.S. average, imd 
a score below one an impact below the U,S, average, 

'I'he time series plots of relative impact for 4 of the 19 selected institutions are shown in figure 8 A- 1. To explain 
the trends observed in these graphs in terms of the fields of .science involved, listings of the most cited papers were 
obtained for each institution, covering items cited 100 or more tinges, down to a maximum of KKi items, 

1) Massachusetts Institute of Teclmolofiy (MIT) has been consistently among th'j top 10 institutions for 
Federal R&D funds received. Like other top 10 institutions, which often produc relative impacts at the 
national average or above, MIT exhibits relative impacts in the 1.4 to 1.5 nmge. MIT also shows a modest 
gain in citation impact. Twenty-nine percent of its most cited papers are from the 1981 to 1988 period. 
Biomedicine has l>ecome stronger, while chemistry and geoscience have tapered off, and physics remained 
about the same. 

' I hi- following IS based on Henry Small. *'niblioMiL'iriL*s ol Hitsic KcscJirch." (VIA conlrac'or report. July \9W Available thr(juy.b ihe 
.National Tcchnital liilorniation Scrvu i'. sec app I- 

Figure 8A-1— Average Relative Citation hnpact for Four Research institutions, 

1973-88 
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2) Uttivirsity ofCalifomia-Sam Barbara (UCSB) hat improved its nuddtig amoog the top 100 lecipieou of 
Fedenl R&D dollan fmm 1967 to 1984. OTA ctili iucli ihstitiitibfis "upwMdIy mo^." Tbeir piitteins 
of reseaichoitqpm are even more <^ UCSB diq>iiyf sveiy inarieed 
inciease in ciution Impict It also has a veiy huge number of 1981 to 1988 paper! in its highly cited set, 
43 percent Even more lonarlcable is the spread of these papen over various dlsctplfaies, widi the emphasis 
on physics. Of the recent highly cited papers, 81 percent are in physics. Other areas xeimseiited include 
biom<N)iciiie. ecology, geosctence. «id chemistiy. 

3) Carnegie-Mellon University (CMU) has been a top 20 recipient of Federal fluds in eaghieering, and 
mathematics and computer science. However, it shows a decline in relative Impact, b«ginniiig in the late 
1970s. An analysis of the 78 papers cited 100 times or more Shows that 15 percent of these papen are in 
the period 1981 to 1988. mile 23 percent of the 1973 through 1980papen were in the discipline of physics, 
only 8 pereent are firom physics in the bter period. Chemistiy, biomedtchie, and computer science continue 
from earlier (0 later periods at compafible levels. 

4) C/rnvmiry^/l/oMftoff (UofflDisanewcomertotheselectgroupoftop 100 recipients of Federal RAD ftwds. 
It displays one of the roost nurioed increases hi citation impact of the institutions exanUned, although it 
staned at a very low level. Its number of papers cited over 100 times is also small at 28. Nevertheless, 39 

- percent of these are from the recent period. Whereas chemistry and biomedicine were dominant early, 
physics (and more specifleaUy, high*tefflpentfure st^jerconductivity) account for most of the new highly 
cited papers (though biomedicine is also represented). Possibly a shift toward strengthening physics 
c<nitributed to the incitase in impact for this institution. 

In some of these cases, it may be possible to attribute changes in citation impact to a shift in the field orientation 
of an institution. Such shifts may be the result (tfdelibente oiganizational dumges, or perhaps dat to a resourceful 
faculty member who is able to move into new areas of researoh. One leey to increasing hnpact is the ability to produce 
a continuing flow of innovative papers that influence researehen "at the firont.'* This relates to the propoition of 
highly cited papers that are of recem origin. Reliance on aging "classics'* will not ensure an upward trend in Unpact. 
Another factor is field balance: some institutions seem to have strength across a number of fields, while other 
institutions focus on one or two seemingly to the exclusion of othen. It is clearly more difficult for an institution 
to maintain excellence across a wide lange of field»--the traditional maric of a research university-'UMa to 
specialize in oat or two.^ 

One lesson from the institutional profiles is that maintaining a high ciution impact over a genmtion is difficult 
at best. The citation uends for UC^B and UofH confirm their upward mobility in research output as well as in 
Federal funding, in contrast to the citation trends at other institutions. 



(ho lop 100 instituiions in Federal RdcD Amding in 1988. only 39 tud « relative ioipaci score above (be national aveiage. Ibkl. 



Not only c;m publishing entities be analyzed, but 
fields of study as well. For instance, "hot fields," in 
which the rate of publication luid citation increases 
quickly over a short period of time, can be identified, 
Research areas such as high-teinperature sufxjrcon- 
ductivity emerge after a major discovery, llirouph 
co-cilation analysis, papers can b(! sorted into 
"clusters" i>r publications that cite each other. 
Tlit'.se research clu.sters can be grouptni t'uither and 
niap{H.'d vviiliiii ili.st ipliiR's,-*' In addition, related 
areas that contnl^uie to the work can be identilied 



and linked across disciplinary boundaries. For ex- 
ample, high-temperature superconductivity research 
has been connected with work in cenunics, ihin 
films, polymers, and other diverse iireas.'*^ 

11' the papers comprismg a cluster cite their 
sources of funding. ;ui estimate can be made of 
Federal support ol" the resciuch represented by the 
clusters. To deinon.sirate this method, OTA re- 
quested Uiat a small sample of pajKMS published be 
seiu-cheil tor funding inlormation in a cluster repre- 



''l iiivl.iK.f.iii..iiv.i| (|,c.ih:<iiiitiiii .iiul ihi- ii.'..i()u-i.iiioii!>i roMiliiii>:iu ui.iiion maps, sec Hi-nf> Sifi.il! .iiid |i (' (inllilli. ■ Hiv r;irmiuii-oI .Su-ihiIk 
I il.-i,inin-sl (if.i|.tiiii>; S\k, mIiks. ' S, „ n, <■ S,!,J,,-\. m.I 4, I') '.;. pp 17 41). ami Ililirs Siii.ill .nul r.ugi-nc (iarfuUl. ' I lu- ( ;i.(n;ritpli> 

oJ.StuiKC l)is.i('lm;iiv N.iiii.iLiI .M.ippii.f;s," / Nm,;.' .y'/ri;,'/r<i.;f(,./i .^. ir'n , , vol II . I )i\ i-filU'f M'S";, pp U/ 1 *;<) 

' Sm.ill.11,.1 IViulk-tuin. op . il , loiHii.nf U. Hu-si- 1 luiiio Imtis ti.nc Ivnu oiiliiincd iiidcpcfldi-ml) Itinuixti .malysis »( oibor. n<mlMbli<.iiK-trir il.it.i 
.S.-c- J.,:ifi .M Kiiu.-ll. Siipiro'iKliuinil;. Kim-.uJi A hilloniil \ uw ' /'/n mi s l.U,. Nii\aiitK-t I'WX.pp •M\ amlDixolhs ki)lniirl .il . •■|Uiii_i;ing 
Stipvr(.(iii.|u>llMI\ |i- M.iiV.<.t." /nil, I in V, ic'li I /c, /I'l . s ii| ^, Sm '. wiiHi'I I'WK SV. pp <S 



ERIC 



BEST COPY AVAIUBLL 



2, 



246 • Federally Funded Research: Decisions for a Decade 
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Figur* 8*1— Rtlativt Citation Impact for National Laboratorlaa 
CItatlona/paptr 



1.3 - 



1.2 



Inoludft: 

Argonnt Natlonil Lab 
Brookhavan National Lab 
Farmf National Aocalarator Lab 
Lawranoa Barkalay Lab 
Lawranoa Livtrmora National Lab 
Lot Alamoa National Lab 
Oak RIdga National Lab 
Sandia National Lab 




— ■ 1 r 1 1 1 r r- 

73-80 74-81 75-82 76-83 77-84 78-86 79-86 80-87 81-88 

Years 

SOURCE: H«nry SmalK "BibllorTMtriot of Basic RtMarch/' OTA oontraotor raporl. July 1090. 

Figure 8-2— Relative Citation impact for Three Induatriea 

Cltationa/paper 
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NOTE: Bht^nohgycotDfmnhM in€iud^:kmqf\, BIOQan. Blotach LatM, California Blotach, Camooor. Catui, Chiron, 
DNAX, Qanantach» Qanatloa lnttituta» Immunax. and MdacUar Qanatioa Inc. EMmtkm Mnd computer 
compmkt$ fnoiuds: BM. DiQltal Equipmant. aanaral Elactrto, Waatin^houaa Elaetrio. Eeatman Kodak, and 
Xarox. Fonun^ 500 Top 20 InoMb: Oaoaral Motor a» Ford Motor, Exxon. BM. Qi*rm%\ Elactric. Mobil. Philip 
Morris, Chrytlar. DuPont da Namoura. Taxabo, Chavron< Amooo. Shall Oil. Proctor a Oamt)la» Boaing, 
Oocidantal Patrolaum. Unltad Tac^ndogiaa. Eaatnwn Kodak. USX. and Dow Chamk^l. 

SOURCE: Hanry Smal "Biblkimatrkx of Baato Raaaarch/' OTA contreotor raport. July 1 MO. 
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Photo endt U.S. Dtpartimni of Eimgy 



Researcher holds • piece of superoonduoting tape. 
Scientists must tw «l)le to make oeramlo superconductors 
In a variety of forms to be usefuMrom thin films for 

electronics to casts for accelerator cavities. The 
developnrtent of ceramic superoonduotors has t)een an 
outcome of superconductivity research. 

senting research directly related to high-temperature 
superconductivity. (Similar analyses were con- 
ducted in four other research areas.^^) Roughly 
one-half of the most cited papers in 198S to 1987 (77 
of 139 papers) were coded for funding information 
and a random sample of the papers that cited them in 
1989 were included (95 of 156 1 ). More than one-half 
of the funding acknowledgments were to Federal 
funding agencies (with over one-half to NSF, 
slightly under one-third to the Department of Energy 
(DOE), and significant contributions from the Office 
of Naval Research and the National Aeronautics and 
Space Administration). Corporations, primarily 
IBM and AT&T, funded another one-third of the 
papers; Federal laboratories, private foundations, 
and foreign sources supplied the remaining funds. 
The Federal Government is a continuing catalyst of 
high-temperature superconductivity research. 

The degree to which a field is international in 
effort can also be indicated through the nationality 
of authors. Again, for the high-temperature super 
conductivity cluster, the most cited papers in 1985 to 



1987 were from the United States ((>4 percent), 
followed by France (8 percent), Japan (8 percent), 
Switzerland (4 percent), Canada (4 percent), and the 
United Kingdom (3 percent). Hie institutions in 
which these papers most often originated were 
AT&T (12 percent), IBM (12 percent). University of 
Houston (5 percent), University of Ibkyo (4 per- 
cent). Bell C:onununication8 (4 percent), and the 
University of Califomia-San Diego (3 percent). 
Countries citing the papers were more diverse, with 
the United States at 43 percent; Japan, F^ce, and 
the Federal Republic of Germany at 5 to 6 percent 
each; the U.S.S.R. and India at near S percent; and 
the Peoples Republic of China at 4 percent. Similar 
diversity is seen in the institutions where these 
papers originated. 

With these types of analyses, bibliometrics could 
perhaps be used to track the evolution of fields and 
subfield»~by research topic and national or institu- 
tional authcMTShip. However, there are significant 
disadvantages to bibliometrics, which also must be 
recognized.^ In particular, citations are not made in 
a uniform way in the scientific community, and 
neither is allocation of authorship. Also, the same 
discovery may be cited in different ways in different 
publications. Consequently, only in the aggregate 
and when comparing similar fields with similar 
citation practices can judgments of hot fields, 
infiuential papers, and prolific authors be made with 
confidence.^' The utility of bibliometrics should be 
seen as "value-added" to policy analysis, not as 
stand-alone information. 

Other Measurement Techniques 

Another genre of outcome measures focuses on 
the research-technology interface. There are many 
examples of data that could be collected to illumi- 
nate the relationship of research to other parts of the 
development cycle. Complicating features, however, 
include technological choice within private or public 
firms that develop technology, utilization of sciace 
and engineering talent, and the transfer of knowl- 



^^Small and Pendlebuiy, op. ctt., footnote 36. 

^As Eugene Gaifteld. founder of the Institute for ScientifK Infornntioa (which pioneered citation datab«.tes and their aiialysii). warns: "You can 
misuse ciution analysis easily— that's the stoty of my life." Quoted in Gina Kolata. "Who's No. 1 in Science? FootiNtes Say U.S.." The New York 
Tiitui. Feb. 12. 1991. pp. CI, C9. 

^See Susan B. Coxzcns, "Utcrature-Based Dau in Research Bvaluatioo: A Manager's Guide to BibUometrics." final report to the National Science 
Foundatioii. Sept. 18, 1989. 
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edge from research centers to other sectors of the 
economy.^ 

Sponsors, at least for basic research, have little 
control over the execution of the projects they 
support. So lack of payoff may be unrelated to the 
intrinsic merits of project design and substance and 
have more to do with the differential competence 
and efficiency of performers. But no sponsor can 
ascertain the most competent, creative, and efficient 
of performers.*' 

In the case of public programs with firm measures 
of outcomes, negative evaluations suggest teimina- 
tion. But for programs whose output is information, 
the situation is highly problematic. Information 
volume and quality might be low, but this nuy be 
because the overall level of resources is too low. Or 
a program may have technical inefficiency due to 
poor management. Or the lack of results may itself 
have high scientific or technological value. Since 
research deposits knowledge into the scientific 
literature, it may take years to be applied to other 
problems. Some ideas are premature, and others 
remain invisible to specialists in fields different 
from the authors' own. Recognition of the utility of 
research — both intended and unintended— is often 
delayed.^ This does not depreciate its value, but 
does impede its use. 

Historically, science and technology are full of 
sudden reversals about the value of information 
produced by past research. Tbsting hundreds of 
compounds for superconductivity was, until re- 
cently, not considered high-grade science, but mun- 
dane science. And any evaluation of this work would 
have suggested that this kind of research was not 
worth much investment. Similarly, the funding of 



the early recombinant DNA projects was not done in 
the name of expected high payoffs. Certainly no one 
at the time imagined a biotechnology industry as the 
result. Thus, the ability of research evaluations to 
provide credible estimates of the incremental infor- 
mation gains from additional funding is weak. 
Federal agencies tend to use an insurance principle 
and spread resources widely to ensure that no 
reasonable bets are overlooked. (From one perspec- 
tive, this is risk-averse; from another it is risk-taking, 
because ideas from out of the mainstream can be 
supported.) 

Bibliometrics and production function data on the 
research-technology interface are examples of tools 
that could be used to evaluate outcomes. While not 
exhaustive, they illuminate different aspects of 
science as a process and the utility of research 
performance.*' As with the examples discussed 
above, data collection can be improved when the 
user of the data and the purpose are targeted. The 
next section explores how data on the Federal 
research system is employed by policymakers and 
how new data could aid the transition from analysis 
to decisionmaking. 

Utilizing Data 

In a policy context, information must be presented 
to those who are in positions to effect change by 
allocating or redirecting resources.^'' In the diverse 
structure of the Federal research system, many actors 
play roles in research decisionmaking at many 
different levels. These actors require data reported in 
various forms and units to make decisions. For 
example, an agency program manager requires data 
specific to the purview of his or her programs, while 
0MB and OSTP must be aware of trends in science 



^iven the large, but cheap increaies in computing power, varioui modeit are conunooly used by managemeut aoalytti for deciding on ex ante 
investments, but these techniques remain very sensitive to subjective and highly uncertain estimates of technical and market success. One notable 
exception is Edwin Mansfield, "The Social Rate of Return From Academic Research," Rtttarch Policy, foithcomiog 1991 . 

^^Recent advances in methods of measuring returns to basic research have centered on sophisticated ecooometric techniques for estimating production 
functions (e.g., measures of the economic impact of research). Since the marginal value of research is heavily dependent on downstream events, 
production Ainctions could be embedded in fuller models of information flow and economic behavior. In addition, literally hundreds of quantitative 
project selection methods exist in industry for guiding investmenu. Methods include elaborate goal programming and analytical hierarchy models; the 
techniques are often known m retum-on-investment, impact matrices, or checklists. See Harvey Avcrch, "Policy Uses of 'Evaluation of Research' 
Literature," OTA contractor report, August 1990. Available through the National Technical Information Service, see app. F. 

^SccGunthcr S. Stent. '"Prcmaiuriiy and Unkjucncss in Scientific Tiitcoycry," Scientific Amerf can. vol. 227, December 1972, pp. 84-93; and Julius 
H. Coniroe. "The Road From Research to New Diagnosis and Tbetnpy," Science, vol. 200, May 26. 1978, pp. 93l-9.')7. 

^'Thc application of bibliometrics to patenting behavior, i.e., measuring the dependence of patents on the scientific literature, has pioneered new ways 
of thinking about the diffusion and application of research knowledge. Sec Francis Narin ct al., "Patents as Indicators of Corporate Ttchnological 
Strength." Research Policy, vol. 16. 1987. pp. 143- 1 5S; and Zvi Griliclws, "Patcnl SUtistics as Economic Indicators: A Survey," Journal of Economic 
Literature, vol. 28, No 4. Dccemba 1990, pp. 1661-1707. 

"For example, sec Curo! H. Weiss, "Improving the Linkage Between Social Research and Public Policy." Knowledge and Policy: The Uncertain 
Connection, L.E. Lynn (cd.) (Washington, DC: National Academy of Sciences. 1978), pp. 23-81. 
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that span broad fields, institutions, and agencies, as 
well as those that apply only to specific fields, 
performers, and sponsors. Timely data are similarly 
important. For instance, world events can alter the 
perception and utility of even the best information 
and analysis (see box 8-B). 

Providing data at each of these levels is a large 
task, but one that is essential. As seen with projected 
shortages of scientific and engineering personnel, 
trends are often specific to disciplines and to types 
of institutions, and decisions that take into account 
these differences would best address impending 
problems. Enhanced internal agency data collection 
would help to disaggregate and distinguish trends 
most relevant to the agency. 

As well as targeting data collection to the needs of 
decisionmakers, the data above must address policy- 
relevant questions, i.e., be used evaluatively, as well 
as illuminate signiflcant trends.^' Thus, there has 
developed a distinction between standard data col- 
lection (i.e., tabulations on one variable, such as 
Ph.D.s awarded) and the development of indica- 
tors — data presented in such a way (e.g., compari- 
sons between variables) as to suggest patterns not 
otherwise discernible. For instance, data on the 
rising cost of equipment in a specific field (or the 
rate of change in this cost) have little meaning unless 
compared with the cost (and percent change) of 
equipment in other fields. A measure of the relative 
cost of equipment in different fields would indicate 
the need to make special provisions for equipment in 
select fields. Similarly, data on the decline of 
baccalaureate degrees in a natural science field are 
more useful when they are compared to other broad 
fields, and judged in terms of absolute and relative 
declines and stability. 

Indicators do not necessarily prescribe a course of 
action, but they warn of possibly significant trends. 



As part of the decision process, they offer "usable 
knowledge."'^ At present, indicators on the Fed^ 
research system are neither comprehensive nor 
objective-driven.'^ The focus of the Science A 
Engineering Indicators volumes has been less on 
indicators than on data. Indeed, SEI is a statistical 
reference book that collates available data on the 
research system. Additional efforts to produce 
indicators, especially on research performers, could 
greatly enhance utilization and action by decision- 
makers. 



New Indicators 

NSF, specifically the Special Data Group attached 
to the Director's Office, has recently attempted to 
develop new indicators related to research participa- 
tion at NSF during the 1980 to 1989 decade.^ These 
indicators are defined and summarized in table 8-5. 
Though their meaning is not always straightfor- 
ward,'' these indicators represent a significant 
advance in reconstructing trends in NSF proposal 
and award activity. 

The first indicator in table 8-5, the Proposal Success 
Rate, is driven by the change in the number of 
proposals sulmiitteid. At NSF, this number increased 
by 30 percent during the decade. Over 20 percent of 
those originally declined resubmit proposals to NSF 
(with an equfd proportion submitting elsewhere). 
While the Proposal Success Rate declined fi-om 38 
percent in the beginning of the decade to 31 percent 
in 1989, PI (Principal Investigator) Success Rate 
from 1980-82 to 1987-89 remained above 40 per- 
cent. The PI Success Rate indicator allowed NSF to 
conclude that more Pis are being funded, but they 
facer stiffer competition to win awards. However, 
the relation between these two Success Rate indica- 



^ 'The mettiodologica] pitfalls in applying rfau lo evaluale national or institutional recearch perfonnaoce are illustrated in Jobs Irvine et al., "Investing 
in the Future: How Much Oovenuncnis Pay for Academic Research." Physia Ibday, September 1990. pp. 31-38; and Jeremy Cberfas, "Unlvenity 
Restructuring Based on False Premise?" Science, vol. 247, Jan. 1 9, 1990, p. 278. Fw fuitber discussion, see David C. HoagUn et al., Data /or Decisions: 
Information Straiegiei for Policymakers (Cambridge, MA; Abt Book*. 1982). 

'^luules E. Liiidblom and David K. Cohen, Usable Knowledge: Social Science andSocial Problem Solving (New Haven, CT; Yale Univenily Press, 
1979). 

^^CoTMiis, op. cit., footnote 4, pp. 15-17. 

^Thc Special Data (jroup is pan of thcCompuoller's Office at the National Science Foundation. It worlcs indepeodenUy of two other staffs in the 
Scienliflc, Ibchnological, and International Affairs Directorate that also develop science indicator*— the Science Reaources Sludiea Division (home of 
the Science & Engineering Indicators volumes) and the Policy Research and Analysis Division (which in 1990 issued the data-laden. The State of 
Academic Science and Engineering). 

'^Tbese arc based on National Science Foundation, "NSF Vital Signs: Trends in Research Support. H«cal Years 1980-89." draft report. Nov. 13, 
1990. 
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Box at a Wild Quti: Th« Im^ 

After ^MA War Q came ScUnct'-^ EmBesi FrontierXA mtkntatiM iot ito weUUt md newly ewaie 
of iu letjtmuibUities in die iv«ri^ 
benefit ttomjovenimentftin^ 

w» with > pptitive iiiMie» a jneet deal ctf moijMniiifn, jnd » mqag Imii for FBdeql wppoit 

Vietnini, n oijpopuler war wtth iBclear defoUaticii, liipi^ Agent Oianfe, and 

accutitioni of cnviiooiiimtal degndatiott. Sdcnce and teehnolQgy, were cait in anefative liglit of die atonic bomb 
drop! on Japan and tarnd witfi die tenth of dewttctioii. Attt^^ 
lenuMttrtt of thti antitr iffn cft twitimenf tfp rtB with wt todpyr 

Tlie United States haajuat waged the moat teotnotogical war die 
of cootfoveray and filled test reauha, the Patriot tniaaife aecved a cofc^ 
itt outdated technology i the fttribc atreogtfMoed die claima of aome that eleet^^ 
What such aucceu may mean for die lUmie image of aeienee and technoto^ 

War ii a wild caid Ita effectt on die populace M laife (and on potential acien^ 
paiticular) are difficult to predict War ia a itudnder diat eventa outiide of adence can leverbente in many 
wayf--<hanghig imagea and attimdet--iQr a kng time to come. Analysea aiMl repofta on acienoe 
Midi aa this one. can onlv beafai to meaniie. mudi leaa antidoate. iheae imractSi 



>Thiibo« ii biiod on adMnpM iy Akft l*<io^ 
Advlaofy Pttel for (hit 01A npoii 

^Sm Sidpey Podcowta, ''Hit War Science Wefed,** The WMhlntm Pen, Mar. 3« 1991« p. C2. 



tors and inferences about PI proposal-writing behav- 
ior is unclear for decisionmaking.^^ 

The Continuity of Support indicator shows that 
nearly one in three of the Pis with NSF support in 
1980 were still receiving support in 1989. The 
Flexibility of Support and Continuity of Support 
indicators together measure the balance between 
providing stable support to (established) investiga- 
tors and retaining the ability to bring new investiga- 
tors into the NSF funding system. Funding of new 
Pis fluctuated with the decline or growth in NSF 
obligations. Also, directorates with higher success 
rates (Geosciences, and Mathematics and Physical 
Sciences) ranked lower in Flexibility, because they 



are supporting a more established group of research- 
ers. 

The Award Size/Duration indicator reflects how 
NSF responded to increased demand for funding. 
Early in the decade, the number of awards was held 
constant but the award amounts were increased; later 
more proposals were funded and median award size 
did not grow. Throughout the decade, median annual 
award amount represented 80 to 85 percent of the 
requested amount.^'' 

Indicators are best used to monitor trends, espe- 
cially if they could be extended to other agencies as 
well.^* This would help to complete the picture of PI 
proposal-writing strategy and the distribution of 



^Lifulu Parker. Comptroller's Office. Natiorml Science Foundalioru personal communication, January 1991, ituggests that more proposals are being 
subtnitte<l and titc principal investigator population is increasing, but resubmissions (of previously declined proposals) account for only 20 percent of 
the growth. Jrnnes McCullough, Comptroller's Office. National Science Foundation, personal communication, March 1991, reports that 30 percent of 
the proposals received by the National Science Foundation (NSF) in any year came from researchers who h&d not xubtnitted in the previous 5 years (which 
NSF defines as ' 'new investigators' ' ) and another 20 percent are received from researchers who lubmined only one proposal. The supply of "new blood ' ' 
and demand for funding seem hearty. 

Award amounts are negotiated. Principal investigators inflate their requests in the expectation that they will not receive "full' ' funding. If declined, 
their resubmissions tend (o feature smaller budgct.s In multtyear (e g , 2 to 3 year) awards, which are now typical at the National Science Foundation, 
annual project budgets are fixed at the outset of the award, subject only to across-the-board cuts in succeeding years. (This contrasts with the National 
Institutes of Health's practice of annual downward negotiation in inuUiycar awards.) Robert P. Abel, Office of Budget and Control, National Science 
Foundation, personal communication. July 1990. 

'•'Ilie National Science Foundation cautions about the interpretation of indicator trends. Changes may be due to: a) an across-the-board budgetary 
upheaval e g . the Gramm-Rudman sequester of 1986. which reduces the capacity to fund; b) a targeted increase or decrease in appropriations to a 
directorate (or more generally, any agency line 'tcni). or c) agency reorganization or creation of programs tlat shifts proposals and awards in ways that 
affect disagi^egaled uses of an indicator. 
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Ttbl* S-5-Ntw Indtoatort of RtMtreh AetlvHy at NSP: Pltenl YMrt 198M9 



Indicator 



MMtlon 



Proposal Sue* 
osMRata 



Ratio of awards to total aotloru (naw award 
and dtoiina dtolsioni) on oompatltive 
(paar* or maHt'raviawad) proposals 



Measuras at an agoragata iavai proposal activity and awards that 
rssult In National Soianoa Foundation (N8F) commitmant of naw 
fuodlngi 

mtaipratation of tha Indloater Is not straightforward. Assumss 
aMlmatss of growth m tha rasaaroh woric foroa. iWng oosts of 
rssaaroh. changa m proposal raviaw erf taria, and a pratifaratlon of 
spaoial award catagortas (sat^astdas). Tha Indicator doas raquira 
knowtadga of agency oontaxt 

Comrasts with Proposal $uooass fUta. whkh Indlcatas N8F action 

ganaratsd by proposals sutmittad to it 
IMaasurasaffort and success of tha research population to gain NSP 
support Including changes m mean number of submissions 
needed to ¥rfn one award. 

Indicator Is most revealing when compared to other Indicators. 
Definition of "Naw Pi" Is only a proxy for "young Investigators." 

Indicator complements ^'Flexibility." which measwes awards to 
mvocitlgators without prior awards, it can be indexed to any cohort 
of granteee and caleuiated for prior or succeeding years, 
indicator identifiee investigatwi «vith suatalned support. 

Changa from total doKars obligated in a particular fiscal year to 
amount of award over its lifetime provides a more accurate picture 
of support as experienced by tha Pi. 
/Wvard size and duration affect the character and pace of research 
activity. Reduced award size may effect number of proposals 
written, while reduced duration may affect frequency of proposal 
writing. Both require investigator time for research. This Indicator 
assumes no other, i.e., iioii^NSF, source of research support It 
requires caution in maidng inferenon about time spent in proposal 
writing. 

SOURCE: OHlM o« T(Khnolo«y AMmmwrt, 1M1, bM«d pn National SdtnM Foundation, t43F Vltti SIgnt: Tr«ndt In R«Manh Support, YMro 
leso^e," draft ropon, Nov. 13, 1000. 



PI Success Rate 



FlexMllty. New 
PI Funding 

Continuity of 
Support 



Award Size/ 
Duration 



Number of principal Investigators (P)i) who 
are successful (within a 3-year period) in 
winning an award divided by total number 
of investigators slotting proposals 
(within the same 3 fiscal years) 

Percentage share of total award doNars 
going to Pis who have not had NSF 
support In the previous 5 years 

Percent of principal Investigators receiving 
support at tha start of a time period who 
are still receiving support at the end of 
the period 

Total award dotars divided by total award 
years (duration) 



research demand by field and agency. Thus, indica- 
tors could become an important part of the priority- 
setting process. Perhaps this argues for OSTP to 
coordinate across agencies the development and 
presentation of a prescribed set of indicators. Disag- 
gregated to reflect disparate agency structures, such 
as directorates and divisions at NSF, such indicators 
could also ^^Ip portray variations in fields and 
research communities. Sensitivity to such disaggre- 
gations may be most instructive for research funding 
poUcy. As an NSP task force recently put it: 

Pan of the problem is a lack of understanding of 
the actual size of the research community and what 
fraction of a specific community should be funded. 
A clear, cohemit picture of community size is 
essential. How many grants should be awarded and 



at what budgets? Should NSF fund all fields or make 
choices predicated on the Investments of others? 
This "snapshot" of the community should be 
updated regularly in mder to indicate adiievement or 
changes that might be necessary to minimize confu- 
sion with respect to overall NSF policy issues.^' 

, '< A concurs. Such baseline information should 
be routinely available to decisionmakers in the 
19908. Overall, sets of indicators that draw on these 
data are preferable to single measures. With this in 
mind, OTA (building on the new NSP indicators 
reviewed above) suggests the following four sets. 
They could be conq)lled and analyzed by all of the 
research agencies or by OSTP, which would comple- 
ment existing indicates constructed and reported in 



^Soim of lb« MicMort preteoied tbove were indeed lued for m Inbouse evahutkm of tow lo lOMinUne tbt workloM) of lite NiUoimI Sdeoce 
Foonditioo'i program tUff ud Ibo external rtie«rch cocomaxUty. Sbon-knn recofntneodttiooj fociu oa fUnpUfytiif the propoMl prtptntioa lod review 
pioccti, iaclodbis bydgets; loog-leriD recoattneodttioai Include waya of balancing npport modei and reMvctwing graat lyp^ (lize and dwation), 
cipedally ct ou-dbectorate progranu. See Naliooal Science Foundation, Rtpon <4 ihe Mtrti Rtvitw Tadt Pore*. NSP 90-1 1 3 (Waihington, DC: Aug. 
23, 1990). 



ERIC 



292-863 0-91-9 



260 



252 • Federally Funded Research: Decisions for a Decade 



SEI, to provide windows on various segments of the 
Federal research system: 

• ** Active research community" indicators, 
which would estimate the number of research- 
ers actively engaged in federally funded re- 
search <e.g., Pis currently supported by one or 
more Federal grants plus those with a research 
proposal pending at a Federal agency, and 
proportion of research time that is federally 
funded). 

• "Research expenditure" indicators to recali- 
brate Federal expenditures by line item of 
research budgets (e.g., salaries, equipment, and 
facilities) and by broad field. 

• Federal ''proposal pressure" indicators, e.g., 
proposals submitted to the Federal Government 
per investigator, ratio of Federal to (investiga- 
tor's self-reported) non-Federal proposals and 
pi'ojects in force at the time of submission, ar d 
fraction of requested project budgets actually 
awarded by the funding agency. 

• "Production unit" indicators, e.g., the size of 
the research team or other performing unit 
supported in part through Federal grants (dis- 
aggregated by subfield, institution type, and 
agency source). 

The combination of such indicators would esti- 
mate more precisely the changing parameters of the 
Federal research system.^ This information could 
be invaluable to policymakers concerned about the 
health of certain sectors of the system. To produce 
such infomiation, as part of ongoing agency data 
collection and NSF responsibilities for collation and 
presentation, extra resources would be needed. They 
might come from streamlining cunent NSF data and 
analysis activities, such as a reduction in the number 
of nonmandated reports issued annually, or desig- 
nating a special unit, much like the Science Indica- 
tors Unit, to expand its inhouse and extramural 
"research on research." If there is a premium on 
timely information for research decisionmaking, it 
must be declared (and funded as) a Federal priority. 



The utility of data is judged by many participants 
in the system: the needs of Congress are usually 
agency- and budget-specific;^* the agencies, in 
contrast, worry about the performance of various 
programs and their constituent research projects. 
Data converge in one other underutilized source of 
information— the evaluation of research projects 
and programs after they have (or have not) produced 
results. 



Evaluation of Research 

While data and indicators can provide valuable 
infcnnation on aggregate trends in the research 
system, it is much more difficult to evaluate specific 
research investments in agency programs or projects 
(apart from charges of fraud, incompetence , or other 
gross flaws, which are investigated as p7Jt of the 
congressional oversight function). The returns from 
the performance of research to society are quite 
diverse. They include economic, health, security, 
educational, and many other benefits. Because 
research is a public good, there is little incentive for 
private investment (in terms of social returns). In 
1986, OTA looked at ways to measure the returns 
from public investments in research: 

In summary, OTA finds that . . . the factors that 
need to be udcen into account in research planning, 
budgeting, resource allocation, and evaluation are 
too complex and subjective; the payoffs too diverse 
and incommensurable; and the instituticNial barriers 
too fomudable to allow quantitative models to take 
the place of mature, informed judgment.^^ 

Five years have passed since OTA announced this 
conclusion. However, demand for research evalua- 
tions has increased in all countries that make 
significant investments in research. The reasons for 
increased demand arr the same: budgetary con- 
straints, greater accountability to sponsors, and the 



"'Hor example, whti would be the indkatioiu Itut growth in research productivity U ilowlof or thai the ilze of a reiearch community ii preca/ioiuly 
targe or tmall relative to the rewurcei for lupporting it? See CoUeen Cordei. "Policy Expertt Aik a Heretical Quettioo: Has Academic Science down 
Too Big?" The Chronicle of Hither Education, vol. 37, No. 2. Nov. 21. 1990, pp. Al. A22. 

*>Ai several National ScieiKC Foundaiioo staff have Indicated to OTA project staff (penonal cominunlcatlotu, October-December 1990), the 
President's Science Advisor draws heavily cm unpublished and newly published 5ct>/i<:« A Engineering Indicators (SBO data in prepariiig and preacDiing 
the Administration's policy proposals at coogressiooal "posture hewings" early in the animal autttoiiiatloD process. Indeed, the production cycle of 
SEI is geared to delivery of the volume u an input to this budget process. 

*^.S. Congreu. Office of Ibchoology Assessment, Research Funding as an investment. Can We Measure the Returns? OlA-TM-SBT-36 
(Washington. DC: U.S. Government Printing Offke, April 1986), p. 9. 
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PMocndHi (/. 8, DtfMitntnt tt Afriouhurt 



Oversized IhornlMS blackberrits, tiny gtf twberry plants (In 
Jart), and ttar-shapad slloaa of earambola (a tropical fnill 
now grown in Rorlda) are examples of outcomes of the 
Diriment of Agrlcuiture's Aortouitural Researcfi 
Service programs. 

desire for increased rationality in decisionmaking.^^ 
In response, many funding agencies~-here and 
abroad— have formed evaluation units.^ Research 
evaluators and desic^ners of science indicators have 
carried out substantial work on measuring scientific 
and technological performance. There have been 
refinements in existing methods for evaluating 
research impacts ex post. Nevertheless, examination 
of the published and unpublished literature on 
research evaluation methods between 1985 and 1990 
suggests that OTA's conclusion still stands: evalua- 
tion methods are not cited as guides to research 
decisionmaking by national governments.^ 

Since 1985, no methods have been invented that 
more defmitively measure the scientific or social 
value of past research investments. By "defmitively 
measure," OT/. means that evaluation outcomes. 



whether positive or negative: 1) vkill be accepted 
without lengthy technical and political diqrates 
among sponsors, clients, and constituents, and 2) 
will provide unambiguous direction in resource 
allocation or other kinds of decisions. While com- 
puter modeling permits greater use of ex ante (i.e., 
before the research project is attempted) project 
selection methods and ex post evaluation methods, 
the evidence is sparse that there is much short-term 
payoff to public or private sector research adminis- 
trators from making greater use of them.^ 

The problem, however, may reside more with 
decisionmakers tiian the evaluation tools (and re- 
sults) at their disposal. Research administrators have 
little incentive to use current evaluation technolo- 
gies for making decisions about awards or level of 
ivoject allocations. This lack of incentive persists 
because research evaluation **. . . occurs in a politi- 
cal context: is inevitably seen as post hoc justifica- 
tion for decisions (unrelated to Uie content of the 
evaluation); and should be anticipatory, designed to 
answer specific questions raised by superiors within 
die organization as well as critics from outside. "^^ 

Below, OTA furst describes evaluation practices 
and processes around the world; tiien considers 
incremental improvements in research evaluation 
metiiods since 1985; and fmally suggests that 
research evaluation faces certain inherent limits. 
These limits make it unlikely ttuit however precise 
Uie measurement of average or incremental mone- 
tary or informational returns, diey may not be 
embraced. Nevertheless, rather dian a means of 
computing returns on past public investments or 
guiding prospecrive ones, research evaluation may 
help Federal funding agencies keep "on tiieir toes," 
just as environmental impact statements impel 



*^Bven countriei Ilut do not make tlgnillcanl : ^arch in vestmenti claim they evaluate. For example, Finland, Hungary, and Poland reported on tbeir 
evaluation efforti In tbe "ECE Seminar on Evaluation in the Management of R and D, Apr. 3-7, 1989." unpublished proceedings. 

•♦For diicuuions. lec Ciba Fi> 'ndation, The EvaluaH(>,i of Scientific Research (New York, NY: John Wiley & Son*. 1989); and M. Gibbons and L. 
Georghiou, Evaluation of Researcft: A Selection of Current Practices (Paris, Prance: Organisation for Economk Coopention and Development, 1987). 

^An annotated bibliography on evaluation of research, 1983 to 1990. contains 147 works published in scientific jouraab and govemmenldocumentf. 
It is the basis for this section. See Averch, op. cil., footnote 47. 

**K.M. Watts and J.C. Higgins, "Tbe Use of Advanced Management Itehniques in RAD." Onuga. vol. 13. January 1987, pp. 21-29. This survey, 
consistent with past surveys, chows that RAO administrators prefer simple, transparent methods of project selection, Interestingly, OTA consistently 
nnds in discusi ions with policymakers in tbe executive and legislative branches that the pn^iitloo "high yield from F^ral Investment in RAD" is 
taken as axiomatic. The issue Is not whether to fund, but what and how. 

'^Cbubin, op. cit., footnote 18, p. 84. Also see Harold Orlans, "Neutrality and Advocacy in Policy Research," Policy Sciences, vol. 6, 1975. pp. 
1071 19. 
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agencies to assess the effects of their programs on 
the environment.^ 

Evaluation In Other Countries 

Table 8-6 summarizes the characteristics of the 
evaluation process among major scientific and 
technological powers.^ Overall, in countries with 
parliamentary governments, national priority setting 
in research becomes a tool both of project selection 
and research evaluation J" The United Kingdom and 
France present contrasts in approaches to evalua- 
tion — the former contracting for outside analysis, 
the latter incorporating analysis of research out- 
comes into the government's apparatus and process 
for policymaking. Smaller countries, such as The 
Netheriands and Sweden, must be selective in the 
areas of research they target. If a ' 'critical mass' ' of 
researchers is not available, collaboration in cooper- 
ative international projects becomes the only outlet 
for research participation.^^ 

U.S. researchers have historically operated at the 
frontiers of knowledge, and other countries have 
adjusted their own research ventures as scientists in 
the United States and other scientifically advanced 
nations uncover promising areas. "Thus it is easier 
for countries off the frontier to identify what they 
want to pursue. Of course, the U.S. enterprise is so 
large tfiat it uncovers more areas than smaller 
countries can afford. So they have a much more 
difficult choice than the United States in determin- 
ing exactly what to pursue. ' '^ Now that the U.S. role 



as a research performer is changing in some areas so 
that U.S. scientists may not always be at the 
foiefront,^^ the time may be ripe to review the place 
of research evaluations— especially relaUve to ad- 
vances in other countries— in agency decisionmak- 
ing. 

An Approach To Evaluating Basic 
Research Projects 

Because of uncertainties attached to each and 
every research investment, procedures for their 
evaluation can be augmented by using ex post 
review by peer researchers and citation evidence 
jointly.^^ One approach would apply the following 
seven criteria weighted by the priority assigned to 
each: 

1. value of the information produced: salience, 
relevance, importance— of both positive and 
negative results— to the field; 

2. probability of use; 

3. originality of results; 

4. efficiency and cost; 

5. impacts on education and human resources; 

6. impacts on infrastracture and capability to 
carry out additional research in the funue; and 

7. overall scientific merit. 

The overall ex post peer evaluation of particular 
projects can be compared with associated bibliomet- 
ric information.^' If this comparison indicates the 
same quality for a project, then the sponsor can have 



•See, for example, S. Tiylof , Making Bureauaacln Think: Tlu Environmeml Impact Strategy ofAdministntIv* Rrform (Sunford. CA: Stanford 
Univenrtiy Prea, 1984); E.N. OokleiAcrg, "The Ttvee Facet of Evaluation." Jouniat ^FolicyAtulytit and Managment, vol. 2, wnaaer 1983. pp. 
ilS'525-,naKW3inkn.Pol{cyThroughImpactAutssmeni:lntHtiaicnalix€dAnafytUataPolicy^^ (New York, NY: Oteeowood Prti», 1989). 
Ilie idea U to induce decUloomaken to iacorporale reieaicb evahuuioo Infoin^ 
puniihmeot. 

•nhe match between coootriei difCttised in app. D of thii leport Hid tboM proT^ 
•ome of the countries cooiidered here, lee Dcpamncat of Trade and Induitiy, Evaluation of RAD— A Folicymaker'i rtrtptctive (Loodoo. Ea|land: Her 
Majeity'i Stationery Office, 1988); Li.. Ledermand. al., "Reaeaich Polidea and Strate^ in SU CowtiiM: A Comparative Analytla," Scienc* and 
Pubiie Policy, vol. 13, No. 2, April 1986, pp. 67-76; B J(. Martin and J. Irvine, Rutareh Foresight: Creating the Future (Loodoo, Englaod: Prancea 
Pinta, 1989); aid AJ'J. van Raan (ed.). Handbook of Quantitative Studies cf Science and tichnology (Amiierdam, Hie Netheclandi: Nortb-HoUand. 
1988). 

^Averch wiitet: "Moti European co«& >i have ministriei of Kieoce and technology that control the flow of leaourcei for SdbT. Theae miniitriea 
ttsuaUy construct SkT plana correlated wito ecooomio plans. Tbey are far more able to direct rcaearch programs at onlvenlties and industrial 
labontories." See H A. Averch. "New Poondatloos for Science and ttcboology Policy Analyiis." paper presented at the Coofereace oo The Mutual 
Relevance of Science Studies and Science Policy, Blacksburf . VA, May 12, 1989. 

^iSee, for cxanyle, Jean-Francois Miguel. ' 'Indicators to Measure IntcmatiOQaUzaikn of Science, ' ' unpublished paper, 1989; and Francis Narin and 
Edith S. Whitlow. Meaturement cf Scientific Cooperation and Coauthorthip in CEC-Related Areat of Science, vol. 1 (Lwonbowg: Commissioo of 
the European Comfflunilies, May 1990). 

^Averch, op. clt., footnote 70, p. IS. 

^Some examples of hot fields dotnimted by oon-U.S. rexircben are presented in Small, op. cit., footnote 36. 

^<Se«. for example. R.N. Kotloff, "Evahistioa of Proposed and Existing Accelerated Research Programs of the Office of Naval Research.' ' /£££ 
Tyamactiwnt on Engineering Management, vol. 35, Novemba 1988, pp. 271-279. 

"See John Irvine and Ben Martin. Foresight in Science: Picking the Winnert (Loodoo. England: ftanccs Pinter. 1984). 
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T8M« 8-e~Characteristlc8 of the ResMrch Evaluation Procasa for Salactad Countriaa 



Qovernmenl 



Methods of ovaluatlon 



Typos of 
rtfoorch 
•valuattd 



Roportod uHHty 



Contral ovatuatlon units 



Oovernment 
standards 



Reporting 



United Kingdom . . 



FRQ 



Japan . 



Netherlands 



Peer review citation; publication; 
rate-of*return; patenta; check- 
llsta; market outcomes 



Economlo and market indicators; 
ex post paer review for basic 
reeaarch projects; spedal com- 
mittees; evaiuatlona of dlsd- 
ptines; biUlometrlce; patents; 
market outoomas 

Consistency with plana developed 
by 'foresight"; market tests for 
applied oommorciai projects 

Peer review; Ml)licatiofvcllatlon 
indicatora tor basic research; 
dient satlataction or utility for 
applied projects; profits earned 
from ressarch contracts 



Large projects; 
programs; 
universities; 
latwratories 



Large and snuill 
projects and 
programs 



Projects; priority 
programs 

Projects; basic 
research pro- 
grams, univer- 
sities, industrial 
research 



Improve policy 
decisions 



Improve policy 
decisions 



Ranning 



Ensure consis- 
tency ^th 
plans; assist 
with allocation 
decisions 



Assessment Offioe within Cabinet 
office; Department of Trade and 
Indiatry has central unit; some 
departments have Chief Sden* 
tiets and Departmental Review 
Committees 

Federal Ministry of Service and 
Te^ihnotogy (BMFT) has central 
unit 



New central science policy unit has 
some evaluation responsibilities 



Yes In public agencies and 
universities 



Definitions of Some public 
good practice 



No 



Some public 



No 



No 



Some public 



AH public 



SOURCE; ^^^^^•^^'"^0^ of Rttearch' Utwsture." OTAcontractof report. August 1990. Note that most oi the llteratu/e on Japan disc^Mes their RSO planning proceseee 

and ths use ol 'loresloht" methods. There le a lees open Uterature on ex post •valuation. naupwrming procmw 
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greater confidence that the project is, in fact, of that 
quality. If the two measures are not congruent, ihen 
die project can be subjected to more intense analysis 
to explain the discrepancy 7^ In addition, an agency 
program can submit information on funded projects 
to experts working at the research frontiers to see 
whether its structure and content are judged as 
significant contributions to the field. This is expen- 
sive, but has been attempted, for example, for DOE's 
Basic Energy Sciences Program.''^ (For a summary, 
see table 8-7.) 

Information is, of course, only one component of 
decisionmaking, and others may be of far more 
importance. Joint, cooperative evaluation of projects 
by researchers and decisionmakers — ^with partici- 
pants inside and outside the research area being 
evaluated—Kiould clarify agency portfolios and re- 
searcher needs.'^^ Nevertheless, the impacts of some 
internal agency research may only become known 
years later. 

Research evaluations can help raise difficult 
questions and uncertainties, but they cannot certify 
worth. There is simply no convincing way to judge 
the value of different kinds of research. However, 
until new techniques, which capture the research 
process as well as its products, are routinely used, 
research evaluations can best be employed to alert 
agencies to potential successes and problems, and to 
keep their programs vigilant in research decision- 
making (see table 8-8). Finally, these measurement 
techniques should be viewed only as one input to 
agency decisionmaking, because nothing can re- 
place the experienced judgment of program manag- 
ers and the scientific community to craft a successful 
research program. 

Conclusions 

There is a wealth of data on the Federal research 
system. However, data are most concentrated on 
Federal R&D funding in universities, degrees 



Tibta 8-7— AtstMmmt of the Dtpartmtnt of Entrgy't 
(ODE) Basic Entrgy Sclonoot Program: 1982 



Objective Assess the quality of reeearoh and performers 
Estimate the In^tof the researoh on DOE 

mlislor) 
Determine program balance 
Tilt appropriatenets of DOE support 

Evaluation Specific loientlflcfmblem 
questions Research design 

Rndlngt (past, current, e)q}ected) 
Impact on DOE missions 

Methods and Ex post peer review 
data SitevisiU 

Publication and citation counts 
Matehing peer review (160 reviewers) and 

bibilometricdata 
Stratified random sample of 125 projects (10 
percent of total portfolio worth $250 mlllon) 

Recognized Reviewer variability (no random assignment of 
oonttralnti reviewers) 

Sample size too snwl 

Outcome 60 percent of prpjects high overall quality 
10 percent of pr^ts exceptional 
10 percent low quality 

Costs and $700,000-$e00,000 
duration l>tenths to complete 

SOURCE: U.S. OapartflMnl of Enffrgy, OltiM of Entigy RMMroh, Oil io« 
of Proflfwn Analyili, An A ut t B irm t t d th» Buio Entrgy 
Seknom Pmgnm, D0E/ER4129 (WMhinglon, 00: 10S2). 

awarded in science, the science and engineering 
work force (especially the Ph.D. component), and 
some expenditure data by performers. Furthermore, 
the most detailed analyses are done almost exclu- 
sively at NSF and NIH, and not at the other major 
research agencies. The highest priority in data 
collection for research policymaking in the 1990s is 
comparable data from all of the agencies, to help 
Congress maintain a well-rounded view of federally 
supported research (for a summary, see table 8-9). 

This chapter has outlined specific areas in which 
useful data could be compiled. Specific examples of 
data on research expenditures, personnel, die re- 
search process, and die outcomes of research were 
detailed. The second priority are data presented in 
forms that are instructive at disaggregated levels of 



7<Soine projecti that were orisinally fuoded could have been rejected io hlodjigbt. Likewise, lome projects that were originally rejected fnlbMy oo«ki 
have delivered reatonabte quality. The only way to ettiinate the quality of projecu an agency rejecu for luppoil ii to trace iU hiitoiy (which ttq/ditt 
the cooperation of agenciei and lavettlgaton;. By examining lamplet of rejected projecu Amded by oQxtn, torn notion of dK impetfecttoni of a 
icicction process that led to unwarranted rejectioo may be (rtKalned. SImllarty, how does an agency, or the relevant program within it, detennine that 
a funded project did not meet iu stated objectives? 

^Por other examples, see National Academy of Sciences, op. cit., fbotoote 8. app. C. 

^See J. ;effrey Franklin, "Selectivity in nmdtog: Evaluation of Research in Australia," Prometheus, vol. 6, June 1988, pp. 34^. Tb« evahiation 
of an agency program would require far more than information on the projects it supports. Rather, questions of Implemeittatioo— effectiveneu and 
efficiency of decisions, and of the program personnel who make them— would dominate. In short, project evaluations aggregated to itw program level 
would estimate the caliber of researcher performance more than success in administering the program. See Eleanor Cheliinsky, "Expanding OAO's 
CapabiUties in I^am Evaluation," The GAG Journal, winter/spring 1990. pp. 43-52. 
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Table 8-8— Dimensions of Agency Research 
Evaluations 



Purpose/research 
question 



Units of analysis 

Outcomes 
Time horizon 



For example, to fund or not to fund, compara- 
tive project performanoe, extent of contribu- 
tion to program mtsslons/ooals. 

Definitions/criteria For example, quality, priority, cost-effective- 
ness, Innovatlveness, success, accountabil- 
ity, impact, productivity, knowledge, growth. 

For example. Institute, division, branch/ 
center, program, project Individual, team, 
publications, citations, awards, rates of 
change, adoption/diffusion. 

Process v. product, form of research v. 
content and outputs, cost per-outcome unit, 
qualitative V. quantitative. 

Duration of award, short- v. long-term contri- 
bution, continuity/culmination v. new direc- 
tion. 

User audience Wsll defined v. fuzzy, disciplinary v. multldis- 
dplinary, knowledge- v, proWenvorlented, 

SOURCE: D.E. Chubin, ''OMionIng Rtsuroh Prograni Eviluallonf: A 
Scitnc^ Studi#s ApproMh," SoiMG^miPuUio Poky, vol. 14, 
No. 2. April1987. p. S5. 



decisionmaking. In particular, data could be pre- 
sented to make suitable comparisons and to gauge 
relative trends (i.e., as indicators of science and 
technology activity)^^ New indicators, grounded in 
the tradition of the SEI vohunes and extramural 
research on research, are needed to monitor changes 
in the Federal research system.^ 

Finally, evaluation techniques of research invest- 
ments in specific programs and projects were 
revisited. OTA fmds that reseaixh evaluation tech- 
niques cannot replace mature judgmenl by poli- 
cymakers. However, specific evaluation tools, such 



as bibliometrics and project portfolio analysis, could 
be further explored. A third priority is ongoing 
project evaluation, which could keep agencies alert 
to changes in research performance, augment pro- 
gram manager judgments about performers and 
projects, and serve to improve overall program 
effectiveness. 

In summary, one of the functions of analysis is to 
raise questions about the information that decision- 
makers are currently using to assess their advantages 
and disadvantages, and to defme a richer menu of 
options. Much information could be collected on the 
Federal research system to map trends at different 
levels of aggregation and units of analysis for 
different users.^^ 

However, the existence of data does not ensure its 
utility, for many policy issues caimot be addressed 
by additional descriptive information. In particular, 
external criteria involving the utility of research or 
impact on objectives can be more persuasive and 
salient to specific policy decisions. Depending on 
one's perspective and scope of responsibility! data on 
budgets, agencies, initiatives, performers, and out- 
comes can nevertheless clarify understanding of the 
evolving research system,^^ 

This information, however, is not cost-free; nor is 
the organization for retrieving and distilling it. 
Congress could consider expanding agency re- 
sources to streamline collection and analysis of 
baseline data. NSF, working in concert with OSTP 
and 0MB, could coordinate and reinforce this 
national data function, and organizations outside of 



^or example, (he Engineering Manpower Commisiion thai asfcmblei, analyzes, and disseminates engineering emoliment and degree figures for 
Uie American Association of Engineering Societies recently remaiked: **There is an old gag among survey researcben that when faced with a choice 
between consistency and the truth, one should always opt for consistency. When the product of the research is time series data that readers may rxwsk 
for years, the virtues of consistency become especially obvious.*' See ''Consistency Versus Relevance: BMC Chaiiges a Statistic/* Enffineering 
Manpower Builttin, June 1990, p. 1. In other words, supplementing a time series with new measures without destroying the continuity of the series is 
also a virtue. 

*^antiutive data will not suffice. Information on the contexts in which research is performed, and characteristics of the performers individually and 
collectively, will provide clues as to how the numbers can be interpreted and perhaps acted on. For example, see Daniel T. IjiyzelL "Most Research 
on Higher Education Is Stale. Irre levant, and of Little Use to Policymakers, * * Tht Chronicit of Higher Education, vol. 37, No, 8, Oct. 24, 1 990, pp. B 1 , 

B3. 

*<Three decades after historian Derek de Solla Price called for a full-blown **science of science,*' the policy potential of "research on research,** as 
illustrated in this chapter, has only begun to be exploited. Price's vision is introduced in Science Since Babylon (New Haven, CT: Yale University Press, 
1961) and Little Science, Big Science, op. cit., footitote 21, and elaborated in a series of analyses temiinated by his death in 19R4. For a retrospective, 
see Susan B. Cozzens, '*Derck Price and the Paradigm of Science Policy, '*5ci>/ice. Technology, A Human \biutSt vol. 13, Nos. 3and4, summer*autuam 
1988. pp. 361-372. 

^^This leads OTA to suggest that the research ageturies. especially the National Science PourMlation and its policy programs, remain in close touch 
with analysts of the Federal r&search .system. Keeping abreast of new measurement techruques aiKl findings related to people, funding, and research 
activities— perhaps through extramural support— would be a modest but fiuitful investment in extending inhouse capabilities and refining knowledge 
of federally sponsored research performance. 
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IHble S-9-D«tlrid Data and Indicatora on tha Padaral Raaaareh Syatam 



Category 



Agency funding 
allocation method 



Research expenditures 



Research workforce 



Research process 



Outcome measures 



Indicators 



Primary users 



Description 



Method 



Congress /^tendee 0MB OSTP 



Funding within and across fields and 
agencies 

Cross*agency Information on proposal 
submissions and awards, research costs, 
and the sixe and distribution of the 
research work force si^^ported 

Research expenditures In aoademla, and 
Federal and Industrial laboratories, 
centers, and unlversity*industry 
collaborations 

Agency allooatlons of costs within research 
project budgets, b¥ field 

Megaproject expenditures: their 
components, evolution over time, and 
constnjotlon and operating costs 

Size and how much Is federally funded 
Size and composition of research groups 

Time commitments of researchers 
Patterns of communication among 

researchers 
Equipment needs aaoss f Mds (including the 

fateofoideouipment) 
Requirements for new hires in research 

positions 

Citation Impacts for institutions and sets of 

institutions 
International collaborations In research 

areas 

Research-technoiogy interfaoe, e.g., 
university/ Industry collaboration 

New production functions and quantitative 
prc^t selection measures 

Comparison between earmariosd and merit- 
reviewed project outcomes 

Evaluation of research prqjects/programs 

Proposal succsss rate, P) success fate, 
proposal pressure rates, flexibillty and 
continuity of support ratn, project award 
and duration rate, active research 
community and production unit Indices 



Agency data 
collection (and 
FCC8ET) 



Agency data 

collection 



Lead agency survey X 



Load agency 
survey; onsite 
studies 



X 
X 



Bibliomotrics; 
surveys of 
Industry and 
academla 



Agency analysis 



KEY: OMB-Ofioe of Msnsgement end Budsst; 08TP-0«ne» ol 8d«ioe end Tschnology Polloy; FCCSET-Fedml Coordinating Council for Sdsncs. 

Enc^noodng, snd Tochndogy; Pli^pflndpsl InvMtlgstor* 
SOURCE: Offico o4 Tschnology AiaMtmont, 1901 . 

the government, e.g.» NRC and AAAS, could also and problems, and pinpoint previously uncovered 
play critical roles, Refming the measui^ment pro- ones, greatly enhancing research decisionmaking at 
cess could help to quantify existing opportunities all levels of the Federal Government 
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APPENDIX A 

Major Legislation Enacted Since 1 975 Affecting 

U.S. Research and Development 



Number and dale 



Title 



Important aspects 



Pul)lloUw 94-282 
May11J976 



Public Uw 95-01 
Aug. 4, 1977 

Public Uw 95-367 
SepL 17, 1978 



Public Uw 96-479 
Oct 21,1980 



Public Uw 96-480 
Oct 21,1980 



Public Uw 97-34 
Aug. 13, 1981 



Public Uw 97-219 
July 22,1982 



Public Uw 96-373 
June 31,1984 

Public Uw 96-462 
00111,1984 



Public Uw 99-502 
Oct 20, 1986 



Public Uw 100*418 
Aug. 23, 1986 



PuMicUw 100-667 
Nov. 19, 1968 



Public Uw 10M89 
Nov. 29,1989 



National Science and 
Technology Policy and 
Organization Act 



Department (rf Energy 
Organization Act 

National Climate Program Act 



Materials Policy Research and 
Development Act of 1980 



Stevenson-Wydler 
Technology Innovation Act 
of 1979 

Economic Recovery Tax Act 
of 1981 



Small Business Innovation 
Research Act 



National Materials and 
Minerals Policy, Research 
and Development Act 

National Cooperative 
Research Act of 1984 



Federal Technology Transfer 
Act of 1966 



Omnibus Trade and 
Competitiveness Act 



Superconductivity and 
Competitiveness Act 



Niitlonal Competitiveness 
Technology Transfer Act of 
1989 



Called for the development of a national sdenoe and technology policy, and a 
national sdenoe and technology base. Created the Office of Science and 
Technology Policy (OSTP) in the Executive Office of the President (EOP) 
In order to advise the President on science and technology, including 
budget issues, and to assess the Federal effort In sdenoe and technology. 

Created the Department of Energy, transferring aH the duties of the Energy 
Research and Development Administration to the Department of Energy. 

Designed to coordinate dimate research among the various research 
agencies, this act called for a heightened effort In dimate research and 
defined the roles of the different agencies who do the research. 

Required the President to formulate a national materials policy and submit a 
plan to Congress, addressing coordination In the executive branch and 
assessnrwit of the economic, industrial, and national security needs 
regarding materials pdlcy. 

Created to promote technological innovation, this act established an Office of 
Industrial Technology In the Department of Commerce, and It mandated 
technology transfer from the Federal laboratories to the private sector. 

Established various tax breaks for research and development (R&D) 
expenditures, Induding a deduction for charitable contributions of R&D 
equipment to universities. 

Aimed at strengthening the rde of small tUm In the performance of federally 
funded R&D, this act required all agendes with large extramural R&D 
budgets to set aside 5 percent of thdr budget {over 4 years) for the Small 
Business Innovation Research (SBIR) program. 

Created the National Critical Materials Coundl In EOP to coordinate Federal 
materials R&D programs. 

In order to stimulate industrial R&D, this act promotes more Joint ventures on 
research protects as It limits the effect of the antitrust laws In such cases, ft 
also reimburses companies for legal costs assodated with frivolous antitrust 
suits brought against them. 

Amended the Stevenson-Wydtor Act to allow govornment'Operated Federal 
laboratories to enter Into cooperative R&D agreements, and established the 
Federal l.aboratortes Consortium for llschnoiogy Ttensfer. 

induded the Training Ibchndogy Transfer Act and the Ibchnclogy 
Competitiveness Act as weli as measures to support semiconductor R&D 
and to protect Inteliectuai property rights. 

Mandated a 5-year National Action Plan on Superconductivity R&D by OSTP, 
as welt as an annual report updating Congress on the Implementation of the 
plan. 

Part of a Department of Defense authorization bill, this act amended the 
8tevenoon*Wy(£er Act to allow government*owned, contractor-operated 
laboratories to enter Into cooperative R&D agreements. 
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Major Uglttatlon Enacted Since 1975 Affecting U.S. Research and Development— Continued 



Number and date 



Title 



Important a»pectt 



PublloUw 101-239 
Deo. 10. 1989 

Public Uw 101*508 
Nov. S, 1990 

Public Law 101-589 
Nov. 16, 1900 



Public Uw 101-606 
Nov. 16. 1090 



Omnlbui Budget Racondlla- 
tlonActof 1989 

Omnibus Budget Racondlla- 
tlonAetof 1900 

Exoellonee In Math«nf«tlc$, 
Science and Engineering 
Education Act of 1990 



National Global Change 
R«MarchActot1990 



Extended the R&D tax aedit for another 9 nmnths. 



Extended the R&D tax credit for 1 more year. 

Aimed at Improvlnr mathematics, science, and engineering sidlls, this 
comprehensive awt authorized various programs focusing on elementary, 
secondary, and higher education. Including programs promoting the use of 
technology In education. 

Amended the National Science and Technology Policy, Organization and 
Priorities Act of 1976 to provide for a national plan to Improve sdentiflo 
understanding of the Earth system and the effect of changes m that system 
on climate and human well being. 



SOURCES: U.S. Congrm. Houm CommlttM en 8oi«no« and Ttohnotogy, A HMory of Sdtoet PoHey In M« IMM SUtM, 1940- IMS, pr*par«d for th« 
Taak Foro* on 6oi«ne« Policy (WuNngton, DC: U.S. Gov*mm«nt Printing OHict, IQeS); CongroHlonal RMcareh Sorvloo, Sdtneo Polloy 
Rmareh Diviilon, SttiMoty PnvMen$ Mtfd fo FttimI R4$4afeh $nd DtvhfjmwH, proparod for lh« Houm CemmittM on Solonoo and 
Toehnology, Suboommlttoo on Domottio and Intamational Sdtntifio Planning and Analytit (Waahtngton, DC: U.S. Qovamnwnt Printing 
Oflica, 1976);andOffiooof Tachnology AMMamant, 1991. 
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The Top 1 00 Institutions Ranked by 
Amount of Federal R&D Funding Received: Fiscal Year 1989 



Doltari 

Rank Inttltutton Qn thou»«nd>) 



1 . Stanford Unlveriity. CA 238,650 

2. Massaehusattt Institute of Technology 215.140 

3. Unlveriity of Wuhlngton 162.453 

4. Unlveriity of Michigan 1 74.675 

5. University ol California, San l>!ego 1 71 .479 

6. umverilty of WlMonsln. MadidOn 1 69.452 

7. The Johni HopWni University. MD 168.164 

6. Unlveriity of California. San Prancisoo 1 59.906 

9. University of California. Los Angeles 1 59.002 

10. Cornell University. NY 1 57.984 

Total, top 10 ln§tltutlon» 1,797,125 

1 1 . Columbia University. NY 1 46,71 2 

12. Harvard University. MA 143,451 

13. Yaie University, CT 1 38.635 

14. University of Minnesota 132.660 

15. University of California, Berkeley 1 24,371 

16. University of Pennsylvania 123,610 

17. University of Southern California 1 19.005 

18. Pennsylvania State University 114.646 

19. University of Hllnols. Urbana 1 14,398 

20. University of Cokxado 1 09.1 45 

Total, top 20 Inatltutlona 9,064,378 

21 . University of Rochester, NY 101.049 

22. Duke University. NC 99.036 

23. Georgia Institute of IMinology 96.048 

24. Wiashington University. MO 96,829 

25. University of Texas. Austin 94,311 

26. TsxasAftMUnlverslty 93.564 

27. University of North Carolina. Chapel Hill 93,280 

28. University of Chicago, IL 90,459 

29. California Institute of Technology 64,167 

30. University of Pittsburgh, PA 81,217 

Total, top 90 InatltuUona 3,906,358 

31. New York University 61,143 

32. University of Arizona 60,533 

33. Ohio State University 75,464 

34. University of kma 74,217 

35. University of California, Davis 72,718 

36. BaytorCoiiegeof Medk:ine,TX 69,336 

37. Case WMtern Reserve University, OH 66,632 

38. University of Alabama, Birmlf)gham 68,204 

39. Carnegie-Melon University, PA 65,079 

40. SUNY at Buffalo, NY 64,453 

Total, top 40 iMtttutlona 4,716,211 

41. Wbode Hole Oceanography Institute, MA 64,333 

42. Purdue University, IN 63,979 

43. University of Miami, PL 63,101 

44. University of Utah 61,619 

45. University of FVxkla 60,731 

46. University of Maryland, College Park 58,924 

47. Indiana University 56,334 



Continued on next page 
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Dollars 

Rank InrtHutlon (In thousands) 



46. Yeshlva University, NY 58,224 

49. University of Tinnessde System 57,763 

50. Northwestern University, IL 57,510 

Total, top 50 Institution* 5,320,929 

51. University of Massachusetts 56,505 

52. Boston University, IMA 56,402 

53. Vanderbilt University, TN 56,151 

54. Michigan State University 51,741 

55. University of Texas SW Medical Center, Dallas 51,254 

56. Unhrersity of Virginia 51,214 

57. SUNY at Stony Brook. NY 49,726 

58. Oregon State University 49,112 

59. Prinoeton University, NJ 47,176 

60. Colorado State University 46,572 

Total, top 60 InstltutlOM 5,838,782 

61. Emory University, GA 46,497 

62. University of Caiifornia, Irvine 46,492 

63. University of Connecticut 46,184 

64. New Mexico State University 4o,660 

65. University of Illinois, Chicago 43,286 

66. University of Georgia 42,797 

67. Utah State University 42,449 

68. Rocl<efeiler University, NY 41,192 

69. TUfts University, MA 40,771 

70. University of Cincinnati, OH 40,598 

Total, top 70 Inatltutlono 6,272,710 

71. University Of HawaH, Manoa 40,574 

72. Uuisiana State University 40,114 

73. University of Caiifornia, Santa Barbara 39,227 

74. VirginiaPotytechnic institute and State University 38,597 

75. North Carolina State University, Raleigh 37,783 

76. Qeorgetown University, DC 37,351 

77. CUNY Mt. SInal School of Medicine, NY 37,233 

78. University of Maryland, Baltimore Professional 

Schools 35,970 

79. Rutgers University, NJ 35,896 

80. Brown University, Rl 34,506 

Total, top 80 Inatltutlona 6,649,961 

81. Virginia Commonwealth University 30,078 

82. University of Texas Health Science Center. 

Houston 29,500 

83. University of Tsxas Health Science Center, 

San Antonio 29.324 

84. University of Texas M.O. Anderson Cancer Center 28,992 

85. iowa State University 28,895 

86. University of Vermont and State Agriculture Coiioye 28,535 

87. Wake Forest University, NC 28.511 

88. Wayne State University, Mi 28,167 

89. University of Medidne and Dentistry of New Jersey 27,983 

90. Oartnwuth College, NH 27,222 

Total, top 90 Inatltutlona 6,937,168 

91. University of Kentucky 27.010 

92. University of Alaska, Fairbanks 26.659 

93. University of Dayton. OH 26.650 

94. University of South Rorida 26,576 
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Dollar! 

Rank Institution (In thousands) 

95. University of Kansas 26,420 

96. University oi Nebruka. Lincoln 25.803 

97. Timpto University, PA 25,232 

98. Oeorge Washington University. DC 25.220 

99. Florida State University 24,897 

100. Oregon Health Sciences University 24,162 

Totat, top 100 InatltutbnB 7,19S,797 

Total, all othar aamplad Inatltutlona 1,354,669 

Total, all inttltJtlona $,550,466 



NOTE: Th* Johns HepMiw Unlvartlty tela) dOM not Indud* 1422 million for tho ApplM Phytic* 
Utwralory. Alw,95o(lh« lOOInititutlons InihofltosiyNr 19a9top 100w«r«sl«ointhe 
fiioal yMr 1088 lilt. Tho eonc«nir(illon/dl«p«rtlon of funding Is ld«ntlc«l In Iho 2 years. 

SOURCE: Natlor:«l Sel«nc* Foundation, Acttkmlo SeitnctfEngint^iing: MD Fun<k—Fl$o»l 
Yuf fM9 (Washington, DC: ferlhooming 1091), tal)l*B«3$. 
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APPENDIX C 

Funding Allocation in Six Federal Research Agencies^ 



National Institutes of Health 

The primary review bodies for grant applications at the 
National Institutes of Health (NIH) are the study sections, 
of which there are over90. Initially, all proposals go to the 
Division of Research Grants (DRO). which assigns each 
to a study section for an initial review and an institute for 
second level review. A grantee cuy request, but not 
designate, an institute; an institute cm request that a grant 
be directed its way. but DRO has the right to ovemile that 
request. Grant applications are classified according to 
type, such as new, competing continuation (renewal), and 
supplemental applications, and according to activities, 
such as regular research projects, conferences, centers, 
and fellowships. Last year DRG received over 30.000 
applications. 

Biennially each institute provides DRG with refenal 
guidelines. The referral guidelines for all institutes are 
circulated and overlaps noted and negotiated through 
memoranda of understanding. Overlaps can usually be 
resolved in this manner. Most often, the issue then goes 
to the institute directors involved for a final decision. 
Grants in the areas of dispute can be assigned jmmarily 
and secondarily to the participating institutes or there may 
be a decision to send the grant to more than one institute 
for dual ftinding. 

Study sections meet several times a year to review 
applications. Each proposal is discussed individually end 
recommendations are determined by maj(^ty vote of the 
members. If the application is recommended for approval, 
each member votes privately, assigning a priority rating 
from one for outstanding to f>vc for acceptable. A priority 
^ore for an application is determined by averaging the 
individual ratings and multiplying by 100. To deal with 
the diversity of rating behavior among study sections and 
because of priority score "creep" (a tendency for scores 
to get better as reviewers realize that only the very best 
scores will allow a proposal to be funded), a percentile 
rank is now calculated for each score. The percentile 
represents the relative position or rank of each priority 
score amwig the scores assigned by the snidy section at its 
last three meetings. The lower the numerical value of (he 
priority score or percentile, the better tlie application. 
Funding units designate an approximate percentile "pay- 
iine," a priority score below which applications will not 
be funded. 

After a grant has been through review by the study 
section, it enters a second level of review by the statutorily 
mandated National Advisory Council or Board of the 



institute. The councils and boards are comprised of 
scientists and lay representatives. They consider the 
percentiles assigned by the study sections and review 
grants for their relevancy to the institute's programs and 
priorities. Councils can choose not to concur with a study 
section approval based on program or policy considera- 
tions. However, they cannot reverse a disapproval action 
when their decision is based on scientific and technical 
merit only. 

The 8v/ard rate is the propoitton of applications 
recommended for approval that arc actually funded In 
1989. the overall award rate at NIH was 29.4 percent. The 
success rate is the proportion of reviewed applications 
tltat are achuUly awarded. In 1989. the overall success rate 
was 27.5 percent. In 1990. Uw award rate was 33 percent 
for competing renewals at the National Instinite of 
General Medical Sciences (NIGMS), 14 percent for new 
applications, and between 12 and IS percent for first-time 
applications. NIOMS budgets ntinority and training 
programs separately, thereby removing them from the 
same level of competition for limited resources (although 
each program is competitive in its own right). 

At NIGMS, nearly 3.000 grant proposals are received 
each year. DRO study sections review the grants for 
scientific merit and amount requested. They then send 
their recommendations to the council for concurrence. 
Most often tiie council will approve blocks of grants. If 
rejected applicants wish to appeal they can submit 
rebuttals. In this case. NIGMS staff then submit their 
reply with the rebuttal to council. They can eitiier support 
the study section decision or the rebuttal. More often than 
not, the council will ccncur witti staff. 

There has been a perception that the woridoad require- 
ments associated with membership on study sections are 
an impediment for recruiting members. A 1989 review of 
study section workload showed Uiat the average workload 
had actually gone down between 1980 and 1988, in part, 
because more snidy sections had been formed. In 1980. 
there were about 70 study sections. In 1988, there were 90. 
Still, the averap; shidy section member spends 45 days 
each year preparing for and attmding meetings. This does 
not include site visits w mail reviews. The average tmure 
of service is 4 years. The NIH peer review system has been 
criticized for repeatedly using the same individuals on 
study sections. In fact, only 13 percent of reviewers are 
reappointed. 

Some managers feel the payline has become inflexible 
and creates too much of a focal point for micromanage- 



'Thii appendix u based on OlA inlerviewi. sprtflg-tuminer 1990. 
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ment. For example, if a program chooses to go below the 
payline and fund an exceptional grant, rejected applicants 
who came in above the payline have been known to 
request intervention by their representatives in Congress. 
The program and the institute must than respond to 
congressional inquiries and justify their decision. Sonve 
managers feel that this teates a disincentive for program 
managers to ignore the payline occasionally when consid- 
ering innovative research. Some policies have been 
created to allow flexibility around the payline to fund 
young investigators and otfier groups. 

However, every institute has an exception process for 
funding. Generally about 10 percent of the research 
budget can be used for exceptions or for applications 
below the payline that are cutting edge and, in the eyes of 
staff, deserve to be funded because of high program 
relevance. At the National Cancer Institute, for e?:ample, 
each division takes its exceptions to the director, where 
they arc put in priority order and then compete for institute 
resources with the executive committee as flnal arbiter. 

Department of Defense 

The Department of Defense (DOD) solicits proposals 
through Broad Agency Announcements, which detail the 
interests of the services, the Defense Advanced Research 
Projects Agency (DARPA), or the Strategic Defense 
Initiative Organization (SDIO) research program. Pro- 
gram managers are allowed much latitude in funding 
decisions, and their performance is judged by the impact 
of the research program on issues of defense interest. 
External peer review may be used, but only in an advisory 
capacity. In general, inhouse review will suffice and 
laboratory personnel are often integral to this review 
process. 

Army 

Of the 6.1, 6.2, and 6.3A budget categories, the Anny 
<listritHited IS percent to basic research (6.1), 46 percent 
to applied research (6.2), and 39 percent in the early stages 
of development (6.3 A). Within the 6. 1 budg^ (fiscal year 
1989), the Army laboratories leceived 68 percent, extra- 
mural single principal investigator grants accounted for 
21 pi^rcent,^ Centers of Excellence encompassed 6 
percent, and inhouse laboratory independent research 
received the fmal 5 percent. 

Within the Army, the 6.1 budg<tt is disbursed by the 
Anny Research Office (ARO). Medical Com^nands, and 
institutes such as *he Army Research Institute for the 
Behavioral and Social Sciences. In addition, each labora- 
tory, institute, or center has its own 6. 1 monies. Huough 



the tri-service University Research Initiative program, the 
Army also sponsors 12 centers iii 10 research areas. In 
addition, the Army sponsors seven of its own Centers of 
Excellence. 

Army Research Omce-^UntU 1985, ARO did not 
solicit proposals directly. ARO has a tradition of support- 
ing single investigators over long periods of time. ARO 
feels that this stable funding environment produces highly 
creative research, both because the investigator has more 
time to devote to research and because stable funds are 
sought by the scientific conununity, and so competition 
is fierce. 

Medical Research and Development Command 
(MR&DQ— Medical research needs are addressed by the 
nine laboratories of MR&DC and monies are allocated 
between them. The largest, with 90 peicent of the 
technology base funds, is the Walter Reed Medical 
Center. Walter Reed employs 1,100 scientists of which 
600 are in the Instihite for Research. About one-half are 
uniformed and the other one-half are civilian. 

Army Research Institute for the Behavioral and 
Social Sciences— -Research proposals are reviewed by the 
Basic Research Office (BRO), the laboratories, and often 
external reviewers. They are rated on five factors: 1) 
scientific significance, 2) potential Army relevance, 3) 
technical merit, 4) quality of executing personnel, and 5) 
cost realism. Contracts and grants are awarded on the 
basis of this inhouse, and partially external, review. Also, 
an inhouse review committee will examine aimually all of 
the contracts and grants awarded in each program area 
Universities receive 80 to 90 percent of the available grant 
and contract funds from BRO. Profitmaking corporations 
receive another 1 0 to 1 5 percent and nonprofits receive the 
remaining 2 to S percent. 

Laboratories—Research laboratories operate primar- 
ily on 6.2 and 6.3 funds, but 6.1 monies make up a small 
proportion of the funding. Funds are distributed to 
research groups through inhouse budgeting. Contracts are 
awarded at program manager discretion after substantial 
scientific review by inhoust personnel.*^ 

Navy 

Almost all Navy basic research money is disbursed by 
the Office of Naval Research (ONR), although many of 
tilt larger laboratories also have small 6.1 budgets to 
support basic research. As part of the Navy*s investment 
strategy for re$^earch» ONR stresses tiiat, while spending 
6(} percent of their funds on '^evolutionary* * research and 
25 percent on research that is * 'closely associated with 



^Note that ibe University Research IniUfttive (i)Rl) fundi are not iucluded iu these figures siikie UKl is now funded by (he Ofiice of the Seca'try 
of Df fenie> 

'for details, see ' . . Vtogress. Office of ^chnology A»«4fS$mc«t. Holding thr hJgt Mmntaining the Otfeme Technology Bast, OTA'ISC-420 
(Washliigtoii, DC: U.S. uovemfnem Priminj; Office* April 1989). especudiy chs. 1 and 3. 
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transition to the fleet/* IS percent of the funds are 
allocated to high-risk, but potentially high-payoff re- 
search. ONR also seeks to leverage funds from other 
departments and industry to boost research in its programs 
in civilian laboratory settings. 

ONR divides its efforts into **core** and ^'accelerated*' 
research initiatives. Core initiatives build on previous 
efforts with slight modifications in levels of funding from 
year to year. Two percent of the research program is set 
aside for core enhancements. Each directorate will 
compete annually for enhancement funds and will often 
solicit external reviewers. Accelerated Research Initia- 
tives (ARIs) provide increased levels of support over 3 to 
7 years. The average funding is about $1 to $2 million per 
year, and about 6 percent of the current research program 
is set aside for new ARIs. Directorates also compete 
annually for funding for their proposed ARIs and, as with 
core enhancements, will solicit both inhouse and external 
reviews, llie core program represents about 70 percent of 
the total Navy research program and ARIs total about 30 
percent. 



Air Force 

Before 1974, inhouse laboratories controlled the 6.1 
monies for the Air Force. However, in 1974, the Air Force 
consolidated iSe direction of the 6.1 monies into one unit, 
the Air Force Offlce of Scientific Research (AFOSR). 
Each laboratoiy still has a portion of 6. 1 monies, but the 
bulk are distributed by AFOSR. The laboratories compete 
for these funds along with universities and other perform- 
ers. 

New initiatives are usually begun with funds desig- 
nated for new starts ($10 miUion in fiscal year 1990). 
Eighteen months before the start of a fiscal year, the 
program managers propose new initiatives. The seven 
directorates then compete for the funds. Each directorate 
is asked to bid for t^^ice thrir "fair share" (or one- 
seventh) of the funds set aside. An extensive inhouse 
review process determines the awarding of funds. Eight to 
10 projects are awarded at about $1 million each. AFOSR 
requires that at least IS percent of the research portfolio 
for a directorate changes composition every year. 

AFOSR had about 1,200 grants and contnacts in fiscal 
year 1990 (about 900 grants and 300 contracts). Roughly 
500 projects are initiated in a year, with an average 
duration of 2 to 3 years. AFOSR works with close to 220 
universities, which receive over one-half of AFOSR 
funding. » aboratories receive 30 percent of AFOSR 
funds/ 



DARPAand SDIO 

Project managers are primarily responsible for the 
selection of contract and grant awards, and usually 
conduct inhouse reviews of proposals. DARPA does very 
little contracting itself. ONR, AFOSR» ARO, or other 
parts of DOD will administt < ^he grant, often because the 
service is the ''customer'* ft the project and will benefit 
from its results. This close working relationship of 
DARPA and SDIO with other parts of TOD facilitates the 
technology transfer of the project findings. 

Although program managers determine the specific 
goals of a project, the development of these goals through 
the letting of contracts and grants is left to Uie agent in 
ONR, AFOSR, ARO, or some other part of DOD. 
(Examples of specific goals include development of a 
particular kind of focusing mirror or more efficient laser 
using a particular kind of technology.) Managers use 
whatever selection mechanism they normally use for 
grants and contracts. 

National Aeronautics and Space 
Administration 

Office of Space Science and Applications 

The Office of Space Science and Applications has two 
primary means of soliciting research/contract proposals* 
Announcements of Opportunity (AOs) are solicited arid 
awarded over the associate administrator's signature. 
They usually call for hardware and experiments for an 
upcoming flight mission, and are funded via contracts. 
Ttiey represent one-of-a-kind oppoitunities with substan- 
tial monetary commitment. The AO is also the primary 
means of selecting the team of scientists for a mission. 
These scientists will not necessarily work together, but 
their combined efforts will set the schedule for the 
mission. 

An AO will state the criteria and the procedure for 
selecting successful candidates. Usually, each proposal 
will he reviewed by panels of peers to judge scientific 
merit. Further review by Nanonal Aeronautics and Space 
Administration (NASA) staff will weigh feasibihty, 
management issues, and relevance to the mission. NASA 
also keeps the prerogative of splitting up a proposal to 
fund only part of it and of joining two or more 
investigative teams togetier. The division will then rank 
the proposals. The final decision is left to the associate 
administrator, as advised by the division. An oversight 
comminee, chaired by ti e assistant associ:;te administra- 
tor, checks the selection criteria for adherence to proper 
procedures and adequacy of documentation of the review 
process. In descending order of importance, NASA 



^One cannot compare directly funding lUocaiion between universities and \h\ oratories, because university funds reflect roughly full costs including 
investigator salaries whereas laboratory scientist salaries are funded ihiough anolber budget line. 
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acknowledges the following criterit to rank pn^sals: 1) 
icientlfic merit, 2) lelevance to the goala of the missiont 
3) adequacy of the leieaich methods, 4) feasibility within 
logistical constraints, S) competence and experience of 
the inveiligatOTi and 6) fiscal and other support by the 
investigator's institution* 

Research Announcemems (RAs) are released under the 
signature of the associate administntor with the division 
director as the selecting official. They are more modest in 
scope than an AO, and more specific in focus. Taken 
together, however, the RAs cover a broader range of 
topics. In some divisions, RAs solicit **guest** observers, 
who will use an apparatus after the original investigator's 
share of the time is up. Theoiy, archival restaich, and 
o^er disciplinaiy areas are also suf^ned with RAs. Like 
an AO, RAs state what selecticm criteria and which 
procedure will be used to make awards. Funding is 
prinuuily through grants. This procedure is usually veiy 
similar iio the one described for an AO. 

In addition to AOs and RAs, NASA employs other 
funding mechanisms. For example, unsolicited proposals 
are encouraged. They are submitted to a peer review 
process that is veiy similar to the procedure outlined 
above for AOs. Also, discretionary mon^ is available to 
the division director, which represents a small portion 
(often nearly 10 percent) of the research monies and is 
disbursed by a less formal procedure (sometimes with 
only internal review) for projects of higher risk or for 
specific needs not addressed through other selection 
methods. Discretionary money is also available to ttie 
program manager. It is often allocated for the use of old 
equipment and flight time on NASA planes, and for 
technology development in preparation for new mission 
proposals. 

Each division has its own method of proposal review. 
In general, however, for every proposal for funds, the 
program managers select the peer reviewers. (Life Sci- 
ences contracts with the American Institute for Biological 
Sciences ( AIBS) to provide all peer review panels for their 
solicited and unsolicited proposals. AIBS has similar 
contacts with other agencies and it provides a ''back 
room*' check on duplication of funding.) For a small 
($100,000 to $200,000) grant, four to five reviews are 
solicited. For larger proposals, as many as eight may be 
requested. The reviews judge scientific merit and techni- 
cal feasibility. Program relevance and all other factors are 
judged by the program manager. It is generally recognized 
that university reviewers give the most con^rvative 
reviews and this lype of factor is taken into account. 

Each proposal is graded from A to B. (At AIBS, each 
reviewer also gives a rating of how competent he or she 
is to judge the science contained in the proposal.) If a 
proposal receives four reviews with ratings equivalent to 



four As, or two Bs and two As, it will generally get 
funded. Anything below four Cs woukl have to be 
defended forcefully within tfie division. However, among 
the group of high sccmng proposals, it is up to the program 
manager to pick and choose to best satisfy his or her 
programmatic goals. Occasimally, there is concem over 
what proportion of the money should go to universities 
and the rest to NASA laboritories and i^vate think tanks. 

Office of Aeronautics, Exploration and 
Technology (GAET) 

In OAET headquarters and in its laboratories, there is 
less reliance on AOs and RAs and more use of Requests 
for Proposals (RFPs). All proposal review for OAET is 
done inhouse. Most of the small aeronautics research 
grants that do not involve ^'cutting metal*' are performed 
by the three laboratcmes (Ames, Umgley, and Lewis) that 
operate with primarily OAET aeronautical research 
fUnds; space technology research is performed throughout 
the centen. If the c<Hitract is large, it will be farmed out 
(primarily) to industry and a laboratory will oversee the 
contract. The laboratories produce specifications, ask for 
bidders, and then negotiate procurement. Roughly 50 
percent of the total research and development funds hi 
OAET stays in the laboratories, 30 percent goes to 
industry, and 20 percent to universities. 



Department of Energy 

The Department of Energy's (DOE) Office of Energy 
Research uses many of the same proposal review tech* 
niques as NASA and the offices of scientific research 
within DOD, with peer or inhouse review for scientific 
merit and final judgment by the program manager. 
However, all tndividmd investigator proposals are solic- 
ited through Broad Agency Announcements. 

The majority of basic research funds at DOE (two- 
thirds of the Office of Energy Research budget, for 
instance) are given to the laboratories. These expenditures 
are estimated for the budget request for DOE and are 
derived through an iterative process with DOE headquar- 
ters. In the defense ponion of DOE, almost all of tlie 
research is done in intramural laboratories. The iPoiKy i3 
competed among them, using mostly inhouse review. 

In the Conservation and Renewables Office and in 
many of the other applied research offices, research 
money is often allocated with an industrial cosponsor. 
Contracts, grants, and cooperative agreements are all 
used. The evaluation of industry contracts is regulated by 
Federal law and is similar to that used by DOD and 
NASA. For individual investigator and university grants, 
peer review for scientific merit generally occurs. Inhouse 
review is used, at the very least, to allocate monies. 
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National Science Foundation 

Prc^sals ait received by the Division of Administra- 
tive Services and are assigned to the approf^te National 
Science Foundation (NSI^ program for evaluation. Most 
proposals are unsolicitedt thou^ a few are in response to 
specific Announcements or RPPk. The applications are 
dien reviewed by the relevant program officer and sent out 
for peer review. Vtopoxn and reviewers are invited to 
suggest reviewers. The program officer may convene a 
panel (ad hoc or standing) to review proposals or can rely 
on mail reviews* or both.^ The program officer can solicit 
advice from advisory committeeSt review panels* or site 
visits before recommending final action. Recommenda* 
tions are then sent to division directors for review and 
approval. 

Prq)osals are funded on the basis of demonstrated 
research p^ormer competence* intrinsic merit of the 
research* utility or relevance of the research, and the effect 
of the research on the infrastructure of science and 
engineering. The success rate for the agency* overall, is 
about 30 percent, but is as low as 14 percent in some areas* 
such as decision^ risk, and management sciences. 

The program officer has a fair amount of discretion in 
making awards recommendations, lypically , after receiv- 
ing the reviews on all proposals (some programs process 
grants on a continuous basis* relying on mail review rather 
than panels), the manager will sit down with the reviews 
and the program budget, evaluate the area of science each 
proposal encompasses, consider how much money the 
investigator is getting from other sources, and thai make 
the difficult allocation decisiras. 

Many program officers said they tend to give new 
investigators a break. Others said they like to help out 
smaller colleges. There is a specific program announce- 
ment called ''Research in Undergraduate Institutions" 
that encourages proposals from nondoctoral depattments 
at instimtions that produced 20 or fewer Ph.D.s in science 
and engineering in the 2 years preceding the proposal. 
Teugets are set for the amounts NSF funds each year in 
this area, and divisions must ensure that minimums are 
met. In some cases, a proposal might be consistent with 
areas deemed of high priority, but would not fare well in 
disciplinary prograrti competitions. 

This is a point in the process where the program officer 
can also participate in the agency goal of increasing 
awards to womf n and minorities. Most program managers 
interviewed consider this an important goal and make 



their best effort to fulfill it. However, it has created a new 
dilemma. Money given to young investigators* women* or 
minorities comes out df a pool that would ncmnally be 
given to the highest scoring proposals* which may come 
from older, established scientists witfi lofty track records. 
Program managers have to make the difficult decision of 
denying grants to* or cutting the budgets of* known 
performers in order to create a more equitable allocation 
of funds. The increasing number of applications* stable 
funding* and the (hoccss of reviewing grants have strained 
the system, say some managers. The safeguards built into 
peer review consume a great deal of staff time.^ 

Forty percent of the scientific and technical staff of 
NSF is comprised of rotaton on temporaiy assignment, 
normally of 1 to 3 years duration.'^ They bring direct 
knowledge of forefront research to the grants process. 
Many interviewees feel that this prevents NSF from 
becoming an entrenched, out-of-touch bureaucracy. Ro- 
tating stiff* however, can disrupt continuity in certain 
research areas, as new grants managers have tfie potential 
influence to shift the focus of research every few years. 

Department of Agriculture 
Ajricultural Research Service (ARS) 

The proposal process at ARS is unique. It is essentially 
a negotiation process between National Program Stafif 
(NPS) and ARS scicntisu. ARS scientists work with their 
regional directors to send ideas up to IfPS program 
leaders. Meanwhile, MPS sets out its budget priorities. 
Once the administrator approves the plan for the upcom* 
ing year, proposals are sent forward to MRS staff. If NFS 
staff want to fund a project, they send the proposal out for 
external review. Proposals are only sent out for review 
<^er the decision hiss been made to fund them. The 
reviewers are not asked whether the project should be 
funded, but how to improve the technical quality of the 
research. This places an enomuHis amount of power in the 
hands ofNPS. 

Obviously, there is room for criticism of this system of 
ex post peer review. In 1986, the ARS administrator asked 
the Board on Agriculture of the National Research 
Council (NRC) to examine the project peer review 
system, assess its effectiveness, and recommend possible 
improvements. NRC found a lack of agreement and 
understanding among AI^ siaff regarding the purpose* 
une, and effect of the system. There also seemed to be 
inadequate understanding within ARS as to how the 
administrator balances and optimizes the dual objectives 



^The National Sckoct Poundatioa tus recently iiutlmted electronic proposal review paoelf . See National Science Pouodatloo, Electronic ProposQl 
Review Panels: An Option for NSF Program Officers (Washington, DC: forthcoming 1991), 

fortbcomiog Oenefil Accoumini Oilice report on poer review piocedurei fotmd no evidence of iloppy practicei at the National Science 
Ftoundadon. Concemi were raised, however, about review pnxesses at other agencies, especially the Department of Energy and the National Oceanic 
and Atmospheric Administration. See David P. HamUton, ''NSP Off the Hook." Science, vol 231« Feb. 15. 1991. p. 733. 

^National Science Foundation, Report of the Merit Review Task Force, NSF 90-113 (Wasriington, DC: Aug. 23. 1990). p. 9. 
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of scientific excelloice and niission relevance, and how 
project peer review is used in the ccmtext of these 
objectives. 

Recently, NSP changed its rules to allow ARS principal 
investigates to apply to NSP for grants. This can be dme 
only when ARS investigators are affiliated with a 
university that becomes the primary recipient of the grant. 
ARS scientists also apply directly for other sources of 
outside funding support to supplement ongoing research. 
Most ARS scientists will apply for other grants to support 
postdoctorates or graduate students. 

One might ask what motivates the ARS scientist. A 
government salary and the system of getting project 
money is noncompetitive. The annual performance evalu- 
ation motivates the ARS scientist to propose good 
projects and perfomi well. In ARS, it is the scientist that 
is peer reviewed* not the research. ARS uses a system 
comparable to tenure review whereby a scientist is scored 
by peers on the level and quality of his or her research. The 
scores determine GS level. If an individual is found to be 
slipping, that is, not contributing to the advancement of 
the field in a manner demonstrated in the past, he or she 
can be demoted. 

Cooperative State Research Service (CSRS) 

Special Grants— The scientific agenda and budget for 
special grants are often specified in the agriculture 
appropriation bill. When given discretion over the awards 
process, CSRS often institutes open competition with 
peer review for scientific merit. Otherwise the research 
agenda is negotiated with the participating institution. 
Within these institutions, there may be competition for 
money (run by the institution itself), but it i > often decided 
informally. 



Competitive Research Grants— The Competitive 
Research Grants Office (CROO) allocates funds with peer 
review mechanisms that are very similar to those at NIH 
and NSF. Review panels, chosen by the program manager 
and associate program manager, judge the scientific merit 
of proposals and their relevance to the purpose of the grant 
program to rank order them. Pfc^sals are funded in order 
until the program runs out of money, and proposals are 
rarely puUed out of rank. 

A new, congressionally mandated experiment at 
CROO limited indirect costs in research grants to 25 
percent in fiscal year 1990 and 14 percent in fiscal year 
1991. The U.S. Department of Agricuhure implemented 
this policy in flscal year 1990 and proposals are now 
negotiated under the new terms. I¥ogram managers 
I^ojected that this ceiling would be useful in fiscal year 
1990 (optimistic estimates said that it would save $3.5 
million to be disbursed to other researchers). After the 
first few years, tmiversities and other organizations are 
expected to biU directly for laboratoiy space and other 
items usually claimed under indirect costs, thereby 
recouping the funds. 

Forest Service 

Research Work Unit Descriptions (RWUDs), written 
by research groups within Forest Service research centers, 
charter work in a particular fvoblem area. They usually 
prescribe a plan for a S*year duration and often will build 
directly on previous work. Staffing needs are directly 
r^lat^d to the RWUD. The station director has a large 
amoi:nt of discretion to choose projects at the RWU level, 
but the RVAJDs are reviewed inhouse in the Washington 
office to provide balance in a nationally coordinated 
^;ogram. 




APPENDIX D 

Academic and Basic Research Decisionmaking in 
Otiier Countries^ 



Compared to the United States, other countries have 
implemented vastly different organizational structures for 
their research systems. OTA has surveyed research 
decisionnuidng practices in nine countries^ including the 
United Kingdom, the Federal Republic of Oermanyi 
France, Japan, the Netherlands, Sweden, Canada, Austra- 
lia, and India It is clear that the institutional structures of 
policymaking and funding are critical determinants of the 
way in which governments support basic research, and 
provide a powerful context to which any new methods of 
selection of basic research must be adapted.^ The reasons 
for this influence are at least twofold. 

First, institutional structures strongly reflect the partic- 
ular political, economic, and, more generally, cultural 
history of a country. While there may be certain universal- 
ity in science, this does not carry over to science policy. 
Thus, it is essential for any comparative study of 
intemational science policies to place them in the context 
of national culture. 

A striking example of these contexts is the heterogene- 
ity of different national research systems. As Ziman noted 
in tlie United Kingdom and the United States, the 
academic department — . . a multi functional organiza* 
tional entity responsible for all teaching, research and other 
activities in a broadly defined scientific discipline . . ."^--is 
the predominant form of scientific organization. In 
contrast, France with its Centre National de la Recherche 
Scientifique laboratories and Germany with its Max 
Planck Institutes have research institutes, staffed by 
full-time researchers working in a designated problem or 
disciplinary area, as the most common model of research 
organization. 

Second, decisionmaking structures themselves reflect 
in part previous processes of selection of basic research. 
Some claim, for example, that: 

... the Big Sciences such as high-energy physics and 
astronomy » which were funded generously in the past are 



now, as a result, well represented on decision-making 
bodies. There has, therefore, been a tendency for early 
established sets of priorities and research interests to 
become **frozen in** the decisionmaking strucmre.^ 

In this section, the research systems in nine countries 
will be highlighted and their priority-setting mechanisms 
examined (see table D-1 for a summary). Unfortunately 
the only ccmiparable figures on the funding of research are 
aggregated with development. Figure D«l shows the 
United States* West Oemiany, and Japan with comparable 
total research and development (R&D) funding levels as 
a percent of ONP, but West Oennany and Japan at much 
higher levels for nondefense R&D. The United Kingdom 
and France spend less on R&D in both categories. For 
ease of comparison to the United States, the focus of this 
appendix will be on academic research, the bulk of which 
is carried out in the national universities of each country.^ 
Some generalizations about methods of priority setting 
will be drawn fu^t between the nine foreign countries 
studied, and then applications to the U.S. research system 
will be discussed. 

United Kingdom 

Three main themes run through the United Kingdom's 
government support of civilian academic science; the 
importance of maintaining and enhancing qualhy in 
science, increasing the economic and social returns from 
science, and better management through greater concen- 
tration and selectivity of science activities. Strenuous 
efforts have been made to introduce new policies to 
achieve those objectives. 

rhe government reviews its R&D funding annually* 
but there is no overall R&D budget. The system is highly 
decentralized and each academic department determines 
its own R&D programs in the light of its own policy 
objectives and priorities. Recent decisions to exclude the 
public funding of near-market research led to some 



*This appcndu ii based on Ron Johnston, University of Wolloogong. AustnOis, "Projecl Selection Mechanisms: Intcraational Comparisons/' OTA 
comraclor report, July. 1990. Available through the National TbchnicaJ !nfornutioo Service, sec app. F. The work on (his cootracl was completed before 
East and West Oeroiany united. Also see Leonard L. lAlennan, "Science and Tbchnology Policies and Priorities: A Comparative Analysis,** Science. 
vol. 237. Sept. 4. 1987. pp. 1125-1133. 

^•'lostimtional structures*' refer to ihe bodies— often administraUve ageoci^^. advisory councils, and review panels— that implement policies for 
piiority setting and funding in science. 

'John Zinum. Resrructurin^ Academit: Science (London. England. Science Policy Support Group. 1989). 

*J. Irvine and B. R. Martin, "Whal Direction for Basic Scientific Research,*' Science and Technology Policy in the 1980s, M. Gibbons and A. 
Udgaonkar (eds.) (Manchester. England: Manchester Universi^ Press. 1985). 
^Except in Canada, where resenxch is conducted in provin . . versities. 
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Table D*1~Reeent ApproachM to Mort Selaetiva Support of Basle Rataareh 



Country/agency 



Priority latttlno; 



8teerino davloe 



Method 



Decisionmaker 8 



Statue 



UK 










UPC 


Selective core funding to 


NA 


NA 


Qovernnnent 




unlveriltles 






appointed 


ABRC 


Interdisciplinary Research 


Submlsstons and Internal 


Panels 


Appointed 




Centers (1988) 


discussion 






SERC 


Directorates (7 years) and 


Internal discussion 


Council (peers and users) 


Appointed 




Prooram (5 years) 








ESRC 


Centres (5*15 years) 


Internal discussion 


Council (peers and users) 


Appointed 


FRO 










DFG 


Priority programs 


Bottom-up discusston 


Researchers 


Elected 


MPG 


Priority research areas 


Bottom-up discusston 


Researchers 


Elected 




Institutes 






Pr9nCB 










MRT 


Programmes mobillsateurs 


Identification of generic 


CPE and department 


Elected and 




technologies 


officials 


appointed 


CNRS 


Annual strategic plans 


Identlficattonof leading 


Council peers and depart* 


Elected and 




researchers 


ment officials 


appointed 


Japan 

Monbusho 


Priority research areas (3'6 


Identification of areas of 


Monbusho Science Council 


Appointed 




years) 


strong sdentlf ic opportu* 








nity and sodal need 








Specially promoted re* 


Seiec lion of 2 Hey fields and 


Science Council 


Appointed 




search (5 years) 


Drooram leader 






NatharlandB 










MES 


Conditional funding of uni- 


NA 


NA 


Appointed 




versity research 








NWO 


Second flow funding 


Identification of future 


BfWB (appointed) and 


Elected 




needs and prkKltles 


NWO 




Swadan 








Cabinet 


Research DOllcv bill 

ltwtiW«4t^At p> ■ • IWW •Fill 


Wide consultation, svmoo* 


Effective consensus 


NA 






slat reports over 2 years; 










and Qovarnmant daoart* 










merrtSi sdentifk: 










sodetieSi researchers 






NFR 


Consortia 


Invitations to consortium of 


Council (appointed and 


Appointed and 






university departnr^ents 


elected) 


elected 






to propose Interdisci- 










plinary programs 






FRN 


Priority fields 


Identification of sodetal 


Council and convnlttees 


Appointed and 






problem, then elabora- 


(research and users) 


elected 






tion of research naeds 










and opportunities 






Canada 










ISTC 


Decision framework for sci- 


Computation of agencies' 


ISTC 


NA 




ence and technology 


research priorities, 










Identifying strengths 










and gaps 







transitory increase in funds for research. Howeveri the 
ftmding outlook has now dimmed.^ 

The major source of funds for academic research is the 
Depaitmem of Education and Science (DES). It provides 
general support for university teaching and research 
through the Universities Funding Council (UFC) and five 
research councils^ in what is commonly referred lo as the 
•*science budget." The DES-supported research councils 



Continued on next page 

provide funds on a competitive basis to university 
researchers and in most cases maintain their own rese^irch 
centers. The research councils have a high degree of 
autonomy in establishing their own priorities and proce- 
dures. The Advisory Board of the Research Councils 
(ABRC) also plays an important role in advising DES on 
the overall budget and on the allocations to the five 
councils. 



*For cxjunplc. tec Jeremy Cbcrf«, "Dcficiu Tnp V.K Science Fundiug A^^rycin,'' Scte/tce, vol. 2.^0, Dec. 14, 1990, pp. 1504-1505; and Fcfrr 
Aldhous. "UK Nuclear Physicists Fear SmC$ Cuts/* Natu/c, vol. 349. Jaa. 31. 1991. p. 357. 
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Itable Recf nt Approath^s to More Solactlve Support of Baste Rasaareh—Continuod 



Priority taming; 



Country/aflency 
NSERC 



Steering device 



Method 



Dedsionmakari 



Status 



SSHRC 

Australia 
ARC 

NH&MRC 

India 
National 

Development 

Council 
SERC 



Strategic grants program 

Strategic research 
program 

Priority research areas 

Priority research fields 



Rve year Science and 
Technology Plan 

Thrust area programs 



Intensification of research 
in high-priority areas 
scheme 



Identification of 30 themes 
In the 3 national priority 
areas by consultation, 
analysis, and woritshops 

Biennial seminars and 
commissioned reviews 

Submissions consultation 
and Internal discussion 

Internal discussion and 
consiritatlon 

Expert reports, consulta- 
tion, draft reviews 

National exerdse of wori(- 
ing paper preparation, 
review, national seminar 

Thrust area Identification 
exerdse 



Sdenoa Council of Canada Appointed 



Council (department off I- Appointed 
dais and researchers) 

Coundl (researchers) Appointed 

Coundl (researchers) and Appointed 
panels 

Coundl (government offi- NA 
dais) 

Coundl and program advi- Appointed 
sory committees (sden- 
tif ic experts and govern- 
ment offldals) 

PACs Appointed 



KEY: 

ABRC ■ Advisory Board of th« RM«arch Coundls 
ARC ■ Australian Rtt&«ardi Coundl 

CNRS « Cantra National da la Rachardia Sdantiflqua (National Centtr of 
Sdentific Resaardi) 

CPf: ■ Cantra do Prospactlve at Evaluativa (Prospects and Evaluation 
Center) 

OFG ■ Deutsche Forshungsgemainsdiaft (Gertnan Rasaarch Society) 
ESRC • Economic and Soioial Rataarch Council 
FRG - Fadaral Raput)lic of Garmany 
FRN m Coundl lor Planning and Coordination of Rasaarch 
ISTC • Industry, Sdance and Tachndogy Canada 
MES • Ministry for Education and Sdanca 
Monbusho ■ Ministry of Education, Scianca. and Culture 
SOURCE: Ron Jotnnston, "Saloction of Basle Rasaarch: An Intafnatkjnal 
National Technical Information Service, sea app. F. 



MPQ • Max Ptanoh Gasallschaft (Max Planck Sodaty) 
MRT - Ministry of Rasaarch and Tadindogy 
NA-Notavailaljle 

NFR - National Sdenoa Rasaarch Coundl 
NHSMRC - National Health and Madical Rasaarcfi Coundl 
NSERC > Natural Sdances and Enginaarlno Research Coundl 
NWO . Natharianda Oroanlzatlon for Sdantif lo Research 
PAC - Program Advisory Commlttaa 
FUWD - Sdance Policy Coundl d the Natherlanda 
SERC - Science and Enginaerfng Research Coundl 
SSHRC • Sodal Sdancee and Humanitiaa Rasaarch Coundl 
UFC - Unlvarsities Funding Coundl 
UK -United Kingdom 
Comparison." OTA contractor report* Juna 1990, tabia 3. Availada through the 



Recently \WC introduce<l a system of ranking aca- 
dciiiic departments on their research capability as part of 
the detemiination of support.^ General University Funds 
arcdislriNited by UFC, one component of which is for the 
support of research, though universities may use these 
funds for education as well. Since 1986, the fomuila to 
determine how much should be given to a department 
favors those institutions judged to have high-quality 
research. In 1989, UFC further ranlccd departments within 
universities on a scale of 1 to 5. Ilic criteria used to 
iicvermine mtings were: 1) pubhcations, 2) success in 
obtaining resciuch grants aiut support for students, 3) 
success in obtaining research contracts, and 4) the 
professional judgment of advisory group and panel 
members, lliere is considerable debate on the efficiency 
of this approach.^ 



ABRC has also initiated or encouraged a number of 
new procedures in the allocation of support for academic 
research. Tlic first has been to increase the proportion of 
funding flowing to ''directed programs*' which have 
increased from 19 to 32 percent of the councils' grants 
since 1980. Tiiese are designed to help coherent programs 
of research in selected areas or to stimulate research in 
fields judged to require nrare effort in the national interest. 
The second initiative has been to increase the proportion 
of program grants, as opposed to project grants, from IS 
percent in 1980 to 20 percent in 1989. Program grants are 
generally larger, support a bigger team of researchers, and 
last for a longer period (S years) than project grants. 
Thirdly, in 1985, it recommended a set of six criteria to be 
adopted by the research councils in determining funding 
(excellence, applicability, timeliness, pervasiveness, sig- 



'Sec "Brilish Scicikrc Indicatiifs." Outlook on Si ii^m ePoiivy, voi. 1 1 . November I9H9. pp. 112-11 1; and M P Carpenter cl aJ., ' 'Bibliometric Proftles 
for (iriiLsh Academic lasliluUoas: An Bxpcrimciii lb [develop Research Output Indicators,' \SVi>/i/o/nr/riri, voL 14, Nos. ^4, 1988, pp. 213-233. 



^Sce Peter Aldhous. *'(Jnivcr.siiy Funding Plan ("ollap.scs in CUaos,** Nature^ vol. 34K. Nov. 1. 1990, p. 3 
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Figure D-1— R&D ExpenditurM at a Percent of Gross National Product, by Country 
Total MD expendituret 
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nificance for education and training, and exploitability), 
which have been applied by f^mc of the councils. 

The most recent initiative, together with the research 
councils, UFC, and DBS, has been the establishment of 
Interdisciplinary Research Centers (IRCs). Funded for 6 
years, their objectives are: 1) greater concentration of 
research effort; 2) more interdisciplinary collaboration; 3) 
increased effort in areas of ^'strategic** science, i.e., 
important for economic progress; 4) stronger interface 
between strategic research in higher education and 
industry; S) more positive and purposeful management of 
research within higher education; and 6) more effective 
collaboration between universities and the research coun- 
cils in the deployment of research resources. 

1lius, the general approach to academic research 
selection in the United Kingdom can be summarized by 
two statements: 1) there is an inciting degree of priority 
setting, the priorities emerging from interaction between 
peer review committees and various advisory bodies;^ and 
2) there is a move to concentrate research resources by 
provision of larger and longer grants to programs and 
centers. 



Federal Republic of Germany 

In contrast to the United Kingdom, the most striking 
feature of German science policy is the indirect influence 
of government^ which fimds virtually all academic 
research but accords significant autonomy to research- 
performing and research-promoting, institutions.'^ The 
freedom of research is expressly established in the Federal 
German constitution. In this context, and that of a 
generous and growing budget for research, it is apparent 
that there is little expressed need for, and indeed some 
hostility to, notions of directed research or priority setting. 

Research is performed primarily in three sets of 
institutions: the SO universities, the 60 institutes of the 
Max Planck Gesellschaft (MPG), and the 13 national 
research centers. Decisionmaking about research project 
selection is' largely made within the research institutions 
or by the Deutsche Forschungsgemeinschaft (DFG — the 
German Research Society). 

DFG is the central, self-administering, academic re- 
search support organization (spanning basic, applied, and 
strategic research) in the Federal Republic of Germany. It 
receives its funds from the federal and state governments. 



forking Group on Peer Review, Peer Review, a report lo the Advisory Board for the Reiearch Councili (London. England: November 1990). 
<^^rhii section has benefited from Leonard Lederman, ScientUk and lolemational Affairs Direciofaie^ National Scieoce Foundatioo. personal 
communication, December 1990. 
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and as the primary source of '*drittmitter*— the addi- 
tional funds for research^-^it exerts influence on the 
profile of research. The function of DFG resembles that 
of the research councils in the United Kingdom. It is 
organizationally independent of government, but flnan 
cially dependent on it. It is a scientific society whose 
membership includes the universities, other research 
institutions such as the Max Planck institutes, seven of the 
national research centers, and prominent scientific associ- 
ations. The president and senate are elected, as are the 
approximately 400 expert consultants who hold office for 
3 years, to provide expert peer review. 

DFG shapes the profile of German academic science 
from the bottom up, augmenting government funding of 
salaries, instrumentation, facilities, and MPG initiatives. 
The resistance to direction of research by DFG is clear: 
*'DFG officials are determined that targeted funds should 
not exceed 10% of overall expenditure since this might 
give rise to renewed alarm about academic autonomy and 
flexibility."*^ 

The functions of MPG are to undertake research in 
areas of particular importance, newly emerging areas, or 
where a concentration of effort is required. Its legal status 
is that of a private nonprofit organization despite most of 
its finance coming from the government. Proposals for 
new instinite> are received each year and undergo an 
extensive evaluation process. Judgments are made by the 
MPG senate on scientific merit, fruitfiilness, appropriate- 
ness to MPG (as opposed to universities), and the 
availability of an outstanding scientist to fill the position 
of leader. Once established, an institute is subject to 
review every 2 years by a visiting committee and every 7 
years by a prestigious panel of overseas experts. Occa- 
sionally an institute is closed. 

The national research centers were e.stablished as 
essentially big science institutes in fields such as nuclear, 
aviation, and space research where a large concentration 
of very expensive infrastructure was necessary. Some of 
these centers are now facing the challenge of missions 
completed or no longer relevant, and are seeking new 
orientations. 

OTA concludes that basic re.search selection in the 
Federal Republic of Germany rests essentially on bottom- 
up proposal pressure and peer review. Priority setting is 
used mainly to achieve concentrations of effort through 
cooperative teams or centers. The unification of the 
former Gennan Democratic Republic and the Federal 



Republic of Germany may offer opportunities of intema-^ 
tional importance for research, but it is too soon to tell^^ 

France 

The French approach to decisionmaking for academic 
research, as for all areas of the economy and society, rests 
on a traditional commitment to centralized planning. In 
the area of research, the strong emphasis is on economic 
goals, and priority is given to industrial research. 

The Ministry of Research and Ibchnology is responsi- 
ble for recommending and implementing government 
policies in the field of science and technology, and for 
determining priorities for research, with the advice of the 
Research and Technology Council. Hie performance of 
basic research occurs primarily in the Center National de 
la Recherche Scientifique (CNRS) hiboratories located 
alongside the universities and within the universities, 
which receive core funding from the Ministry of National 
Education and CNRS. CNRS maintains its own laborato- 
ries, independent of universities. The French system relies 
on block grants \o the laboratories and research groups, 
rather than specific project grants to individual research- 
ers. But there is growing academic criticism of CNRS^s 
favored **inhouse*' position as a research performer. 

CNRS finances the entire range of academic research 
from the physical sciences to the humanities. Annual 
strategic plans are prepared, which rely as much on the 
identification of leading research individuals and groups 
as on promising areas of research. In addition, CNRS has 
conducted a range of prospective studies that feed into the 
planning process. 

The French Government has recently mounted a major 
initiative to promote the strategic application of foresight 
and evaluation to the national research system. A National 
Research Evaluation Comminee (CNER) was established 
in response to the government's decision to institute the 
systematic periodical assessment of all research- 
performing institution.s. This follows the experience of 
the National Evaluation Comminee of the Universities, 
founded in 1985, which has assessed the research of 25 
universities on a voluntary basis. 

CNER is responsible for the evaluation of the organiza- 
tion and results of a national technological research and 
development policy. Tb achieve this goal, the committee 
ensures the periodic assessment of institutes, programs, 



''D R. Martin and L Irvine. Research Foresight (London, England: Frances Pinter. 1989). p. 80. Despite the pronouncement, targeted funds are 
suspected to exceed lOpenreni. 

*2Sec Rolf H. Simcn. "Research Landscape Requires Careful Gardencn: Science in Unified Germany— Experts' Opimoai During ViUa-Hugel 
l^Siksy German Rtstan h Service Special Science Reports, vol. 7. January 1991. pp. 11-13. 

*^ForanoverviewofFrance*$ 24 research agencies, see "PAST Guide to French Government KSlO:' French Advances in SStT. vol.4. No. 1. winter 
1990-91. pp. 3-6. 

^^See Martin and Irvine, op. ci:.. foomole 1 1, pp. 47-50. 
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and incentives of all kinds financed from the civilian 
technological R&D budget. 

In summary, there is a strong emphasis on planning and 
direction of research toward technological objectives in 
the French research system.^' The attempt is made within 
the universities to set basic research directions largely on 
the grounds of scientific excellence. However, within 
CNRS, scientific departments put forward proposals that 
are judged internally on grounds of merit and relationship 
to priority areas. 

Japan 

The dense population, a deep commitment to the values 
of the group, and tlie spiritual principles of Confucianism 
have produced a culture that emphasizes the values of 
harmony, respect, and decisionmaking by consensus, 
even if the process is protmcted.^^ These values penneate 
the decisionmaking structures and procedures with re- 
spect to science. 

Within the government, the Prime Minister's Office 
and its key policy body, the Council for Science and 
Ibchnology (CST), exercises the highest level of control 
over the direction of scientific and technical research. 
Four main government agencies in Japan support and 
target R&D: the Science and Technology Agency (STA); 
the Ministry of Agriculture. Forestry, and Fisheries; the 
Ministry of Education, Science, and Culture (Monbusho); 
and the Ministry of International Trade and Industry 
(MITI). 

STA is responsible for the overall coordination of 
science policy among the different ministries and agen- 
cies. It is also responsible for big science and includes 
research instimtes to fill this function. 

While STA is the agency primarily responsible for 
basic research, MITI has had considerable influence over 
research policy in Japan through its emphasis on applied 
R&D. Mm runs 16 national research laboratories and 
develops research programs with industry. These pro- 
grams are most ofien in technological areas in which 
Japanese industry is considered to be weak, into which no 
single company would enter alone, or which are for the 
public good and not necessarily commercially valuable. 
While MITI is most involved in raising the technological 



level of Japanese industries, this is small compared with 
STA's activities.^* 

Monbusho is responsible for the promotion of research 
across all fields and for the national university system. In 
formulating policies, Monbusho consuhs its science 
council, consisting of 27 eminent scholars whose names 
are put forward by the academic societies but appointed 
by the Minister. In addition to general research fiinds for 
divisions of university faculty, construction, and equip- 
ment monies, Monbusho has a new program in which the 
Science Council chooses a research field for priority 
funding (generally two a year). 

The Science Council is a democratic body established 
by law as the representative body of Japanese scientists 
and engineers. It has the right to make recommendations 
directly to the govemment on the ways and means to 
promote science and technology. Among its m^or 
successes was the establishment of nine interuniversity 
research centers. However, in recent years its influence 
has waned in favor of CST. The role of CST in integiBting 
and coOTdinating research has been considerably strength- 
ened through the establishment of a Science and Ibchnol- 
ogy Promotion Coordination Fund, which is used in part 
to support basic research in special priority fields 
designated by CST. 

Thus, the essential process of research selection in 
Japan is through the time-honored mechanism of a 
committee of wise men. Priorities are established by this 
consensual process, involving varying degrees of interac- 
tion with an influence of academic researchers on the one 
hand and govemment officials on the other. 

Netherlands 

The Dutch are among the leaders in f'^nnulating science 
policy in Europe and have canied its implementation 
much further than many other countries. The major 
emphasis of science and technology policy has been on a 
more effective planning and lirUcing of strategic and 
applied research to national economic and social needs. 

The Minister for Education and Science has recently 
produced a discussion document, 'Towards a Science 
Policy for the Nineties.*' As a resuh, the govemment has 
once again decided to elevate science on the Dutch 



»^Sce Rciwi Barrc. ' 'Slralcgic Froctssei and SAT lodicatore: Towards a Key Role In RAD Managemcnl Systems. The Research System in Transition, 
S.E. Coztjctm el aJ. (eds.) (Dordrecht. Holland: Kluwer. 1990). pp. 227-239. For the past 2 years, the Center for Ibchnology Forecasting and Assessment 

the Miniilere de la Recherche et de la Ibchnologie, in conjunction with the Commission of the European Communities, has published an R&D 
Evaluation Newsletter, which reporu the resulu of research evaluation efforts throughout the world. Stressing evaluation has not overtly affected 
planning or resource allocation decisions. 

•*See Genevieve I Knezo, ' 'Japanese Basic Research Policies. ' ' CRS Report for Congress (Washington, DC: Congressional Research Service. Aug. 
I. 1990). 

'^See Council for Science and Technology. Policy Comniittee. Prime Viiiuster 's Office, and Conunitte* on Guidelines for Research Evaluation, Basic 
View on Research Evaluation (Tlikyo, Japan: 1986). 

^•Sce Johnson ChaUners. MITI and the Japanese Miracle (Stanford. CA: Stanford University Press, 1982). 

i^See John Irvine et al. Investing in the Future (Worcester. Enghuul: Billings A Sons Ltd.. 1990). 
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political agenda* The three major objectives for the 1990$ 
are; 1) establishment of a more effective scientific basis 
for key societal functions; 2) achievement of an important 
role of research in the process of internationalization; and 
3) the well-balanced development and application of 
science and technology to economic, social* and cultural 
needs. 

The independent Science Policy Council of the Nether- 
lands (RAWB) is the central advisory body on science 
policy. It has had significant influence on priority setting 
and resource allocation through its reports on future needs 
and opportunities in particular fields. RAWB also under- 
takes assessments. 

Basic research is performed essentially in the universi- 
ties that are funded by the N4inistry of Education and 
Science (which administers over one-half of the govern- 
ment R&D budget) and in the institutes established by the 
Netherlands Organization for Scientific Research (NWO). 
The latter also funds some research in universities. 

Before the latter half of the 1970s, university research 
was largely considered in relation to educational policies, 
with particular emphasis placed on the close relationship 
between academic research and university teaching. 
Gradually there has been a shift in approach developed in 
the last decade or so, and academic research objectives are 
increasingly related to extemal economic and social 
requirements. The scope for effective planning and 
steering of the direction of university research in the 
context of science policy has been consu*ained in the past 
by the funding structures for university R&D. The 
Netherlands is now experimenting extensively with these 
structures and performance assessments. 

A feature of policy in the last few years has been the 
move gradually to transfer responsibility for research 
from government departments to universities or to 
institutes operated by NWO. This represents one element 
in a developing strategy to reshape the existing national 
R&D system, which is widely seen as lacking the degree 
of integration and coherence that is needed if the country 
is to maintain an internationally competitive effort in key 
areas over the next decade. 

In summary, the Dutch Government and universities 
have been particularly active over the past decade in 
reshaping their science and technology policy decision- 
making procedures and capabilities. While this effort has 
been directed to technology development, there has been 
some attention as well to methods of project selection for 
research. Experimentation with these methods has al- 
lowed new policy alternatives to emerge* In particular. 



these new methods allow more funds to be allocated on a 
competitive basis and in privity areas. The priorities are 
determined by traditional committee methods where 
scientific and government interests meet and negotiate 
from their own perspectives. 

Sweden 

There is a long tradition of extensive government 
involvement in decisionmaking in a range of research 
are^s in Sweden, grounded in a lengthy process of 
consensus fomiationi planning, and evaluation. R&D has 
been strongly directed, particularly through the central 
establishment of priorities and funding levels every 3 
years in a Government Research Policy Bill. 

Policies are developed through an interactive process 
between funding agencies, departments with responsibil- 
ity for R&D, and a group in the Cabinet Office, with 
overall responsibility vested in the latter. There is a strong 
bottom*up element in the decisionmaking process, which 
is set against the background of the Bill on Research. That 
this bill is programmed into the legislative process allows 
all the players to develop their initiatives in the period 
leading up to the consideration of the bill. Background 
studies, monitoring of overseas developments, and sym- 
posia that bring together representatives from academia, 
industry, and the government all form part of the process. 

This extensive consultation and debate ensures that all 
interested parties have an opportunity to make their views 
known and that the community in general is committed to 
the areas and issues identified in the research bill. In the 
February 1990 bill, the priority areas were: 1) strength- 
ening basic research in universities; and 2) increasing 
research in five target areas--environment, marine proc- 
esses, public health, industrial safety, and cultural research. 

Basic research, roughly one«<|uarter of Swedish R&D, 
is conducted almost entirely within universities^-^there is 
virtually no government research capacity. Three research 
councils play a major role in determining research areas 
and resource allocation: the Medical Research Council, 
the Natural Science Research Council, and Council for 
Research in the Humanities and Social Sciences. Each 
council has a large degree of autonomy. A fourth council, 
the Council for Planning and Coordination of Research, 
is not a ''research council** per se. It assists in govemmcnt 
research planning and coordination, public understanding 
and participation in this process, and the assessment of 
Swedish research capabilities. 

Strong direction setting characterizes Swedish strategic 
research.^ Less direction is given to basic research, but its 



^Sec Ocorgc Feme* Science and Technology in Scandinavia (London, EngUod: Loogmaa 1 989). Not only is the research evaluatioD treditlon sUoog 
(perfajips the ttroogest in Western Europe), but it aJso involves the participation of forcip scientisu and much public discussion of decisions. See Mkhae) 
Gibbons. Organisation for Economic Coopaation and Devclopaient. Evaluation of Research in Sweden (Mancbestei , England; Univenity of Manchester 
Pres$» 1984). 
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priorities are affected through the connection to strategic 
initiatives. The 3-year research bill provides a strong 
framework for this connection. 

Canada 

Canadian science policy has been marked in the past 
decade by a high level of debate, conflict, and change. The 
major pressure for this change has been the heavy reliance 
of the Canadian economy on its resource-based industries 
and the recognition that such economies are becoming 
increasingly vulnerable and noncompetitive. Canada has 
a reputation for scientific excellence and long-established 
central govemment laboratories. 

Canada is a federal system, with the special require- 
ments for coordination that such a system implies. The 
higher education sector is funded almost entirely from 
taxes collected by the national government, and allocated 
to the provincial governments. 

There is a large set of advisory and decisionmaking 
bodies in the Canadian science and technology system, 
llireeof the most important are: 1) the National Advisory 
Board on Science and Ibchnology, which advis'ss the 
Prime Minister on overall guidelines; 2) Industry, Sci- 
ence, and Technology Canada (KSTC), which coordinates 
industry and academic research; and 3) the Science 
Council of Canada (SCC), which provides independent 
advice on science and technology. SCC has been a 
long-time advocate of systematic research priority setting, 
and IS1*C compiles the Decision Framework for Science 
and Technology, which requires departments and agen- 
cies responsible for R&D to prepare annual lists of 
priorities. 

Nevertheless, while there has been a strong push 
toward linking research more effectively to national 
needs,^' this has been resisted in the case of basic 
research, llie overall framework of planning thus far 
impinges only indirectly on basic research. 

Australia 

Au.slralia is in many respects similar to Canada, with its 
federal structure and its drive to broaden and deepen tlie 
technological ifitensity of its predominantly agricultural 
and minerals-reliant economic base. Thtrc is also a long 
tradition of commitment to internationally excellent 
research, with a particularly strong govemment research 
capability. 



In recent years Australia has developed a sectoral 
model of science policy, with major R&D funding and 
performing responsibilities spread across a number of 
major depaitments. lb overcome problems of fragmenta- 
tion, a Coordination Committee of Scimce and Ibchnol- 
ogy, made up of seniOT officials of the departments, has 
been appointed. In addition, the Prime Minister receives 
advice from the Science Council— composed of minis- 
ters, industrialists, and a minority of scientists, and the 
Australian Science and Ibchnology Council— <:omposed 
of appointed academics and industrialists. 

With nearly 70 percent of research in the public sector, 
there has been a considerable emphasis on restructuring 
to give greater priority to strategic research directed to 
medium- and long-term industrial needs.^^ The universi- 
ties, which are established under state legislation but 
funded by the federal govemment, are also under increas- 
ing pressure to serve national interests. 

In Australia the principles and practice of priority 
setting have been effectively established for strategic and 
applied research.^^ As in Canada, planning for basic 
research has met with a degree of resistance from 
researchers and universities, who have .seen it as a 
challenge to their autonomy. Hence, priorities have been 
applied to basic research only to a modest extent. 



India 

Science and technology (S&T) in India has grown 
under strong and sustained political support. Even before 
India became independent in 1947, the national leaders 
had recognized the role of S&T in national development. 
Nehru's vision of S&T came to be accepted as an 
instrument not only for industrial and economic develop- 
ment, but also for transforming a tradition-bound society 
into a progressive nation.^ 

In line with the concept of socialism, the state continues 
to be a strong supporter of S&T, providing 80 percent of 
the funds for all R&D. It also shoulders the responsibility 
for directly guiding and planning the activities of an 
extensive network of S&T institutions. R&D activities are 
carried out by institutions that come under central and 
state govemment departments, industrial units, profes- 
sional bodies, and by university-type structures. The 



n.iha AlHj-Uban (cd ). ifnivrrsuy Research atui the future of Cantuia (Ottawa, Canada: University of Oliawa Press, 1988). 
"J. rord. ••AustraJii Tills \\% R^D Towards Induslry/' A^^h' Scientist, vol. 1 16. No. 1580. 1987. p. 19. 

2^M. Dod^jxon. •'Naiiorwl Policies- RcwarcK and Ibchnology Policy in Australia: Legitimacy in Intervention/' Science and Public Policy, vol. 16, 
No \ June 1989. pp. 159-166; and Australian Science and Technology Council, Seiiinf^ Directions for Australian Research (Canbena, Australia: 
Australian (kivcrnmenl Publishing Service, iunc 1990). 

Wa. Jain. • *Scicncc and Ibchnology Policies in India.* * Science Policies in international Perspective: The Experience of India and the Netherlands, 
P.J. Lavakare and i Xl. Waardenburg (eds.) (tendon, Hngland Frances Printer. 1989). p. 139. 
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universities carry out research and provide human re- 
sources for research institutions.^^ 

Though the basic orientation of national S&T policy 
has been, and still is, to treat S&T as an integral part of 
socioeconomic development, there have been several 
changes in organization and planning strategies over the 
years. For example, the Industrial Policy Resolution of 
1948 allowed considerable scope for introducing foreign 
technology into the country, but had little influence on 
linking the imports with the indigenous S&T structure. 
Under this policy ethos, an ext^sive government- 
dominated research infrastructure emerged during the 
next 20 years, almost undisturbed by economic develop- 
ments. Priorities in S&T were set by the leaders of 
science, but efforts at formulating policy instruments and 
plans to couple S&T capabilities with requirements of 
agriculture, industry, and other economic sectors were 
weak. 

The Prime Minister of India has always been the 
ministernn-charge for S&T, with tliree advisory mecha- 
nisms at his or her disposal: the scientiflc adviser, the 
adviser for technology missions, and an independent 
1 1 -member Science Advisory Council. India's planned 
approach for the development of S&T became part of the 
national planning exercise. The Planning Commission 
plays a central role in formulating the national S&T 
3-yeiir plan with the involvement of scientists, technolo- 
gists, (uid representatives of concerned agencies and 
departments. 

International Comparisons 

From the discussion above, it is clear that the metluKls 
used for selecting basic research for government support 
vary greatly among countries. For example, Canada and 
Australia are pluralistic and strongly averse to directing 
research initiatives, while there is growing pressure in the 
United Kingdom for priorities to be determined centrally, 
a tradition long observed in France. 

OTA finds that in every one of the nine nations 
examined there has been a substantial development of 
methods for effective targeting of strategic and applied 
research to national economic needs. This push for greater 
economic payoff from research has also led some 
countries to increase their proportions of strategic basic 



research at the expense of undirected basic research. 
There has also been considerable experimentation with 
new methods to identify strategic avenues of high 
promise. However, the development and application of 
new selection methods for basic research has generally 
been approached with considerable caution by research 
funding agencies and been met with considerable opposi- 
tion from researchers. Also, there is no evidence that 
government targeting of research has increased economic 
payoffs. 

Another finding is that the extent of direction of basic 
research is apparently directly related to the need to do 
so— the most important factor is the availability of 
resources to support basic research. In countries like 
Germany and Japan where there appears to be little 
shortage of funds to support basic research, there is no 
great enthusiasm for more central direction of research — 
even though both countries have elaborate mechanisms 
for targeting strategic research and linking it to industrial 
and commercial opportunities. At the other extreme, 
countries suffering a significant squeeze on funds avail- 
able for basic research, and who have been less successful 
in establishing mechanisms for pursuing an adequate 
level of strategic research with a strong application 
orientation, e.g. the United Kingdom, arc striving hard to 
achieve greater government influence over the direction 
of basic research.^^ 

The major vehicle used to influence the direction of 
basic research has been the setting of priorities. Evidence 
of its effectiveness, however, remains limited. Priority 
setting has generally involved the identification of 
research areas of special interest through interaction 
between the academic member? and professional staff of 
research funding agencies and v^uying degrees of consul- 
tation with the research community. In some countries 
fixed sums are allocated for competition in priority areas; 
in others, the priorities become simply another criterion 
to be considered in the evaluation of proposals. 

A recent Organisation for Economic Cooperation and 
Development report noted the broadening of the concept 
of priorities to include not only * 'thematic" priorities 
(e.g., identifying areas and problems tliat deserve greater 
attention such as optics), but also **struaurar* priorities 
(e.g., creating new institutes or research teams, or 
purchasing equipment and facilities).^^ buieed the report 



^Thc number of univeniiics ha<i grown from 20 in 1947 (o 160 In 1987. Less than 10 percent of national reiearch and development expeodlture goes 
10 i\K university system for research, a proportion far smaller than thai in the other countries reviewed here. 

^^ii is a conclusion drawn by economist Harvey Averch in his survey of the literature. See Harvey Averch, ' ' Policy Uses of 'Evahjatlon of Research' 
Literature: Post- 1985 World Research Evaluation,* ' OTA conuactor report. July 1990, anoouted bibliography. Available through the National Ibchnicai 
Information Service, see opp. F. 

^^Udemian, op. cit.. footnote 10. cautions that ^'striving hard" is not the same u succeeding. No country will soon become as centrally controlled 
as France. And there is a culture ofcriticism in some cultures that maslw policymaking letkiencies. The UK» Canada, and Australia* like the United Suics, 
have a tradition of criitci/.ing government. Germany. Japan, and Sweden have little open criticism although problems and dissatisfactions of researchers 
may be as widespread ns in other countries. 

^Oibbuas. op. cit.. footnote 20. 
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argues that the two are ' 'indissolubly linked/ ' as thematic 
priorities cannot be implemented without adequate struc- 
tural support. 

In the nine countries reviewed here, the major form of 
stnictuial priority is greater concentration of research 
resources through an increase in the funds allocated to 
long-term programs and centers. Thematic priority setting 
has also been increasingly applied by the majori^ of the 
countries, though (with the exception of the United 
Kingdom) such priorities represent no more than 20 
percent of research agency budgets. These thematic 
priorities have been established at a number of levels, 
ranging from the national arena to that of the research 
agency, from a set of disciplines or problem areas to 
individual disciplines. 

Examination of the mechanisms and experiences of the 
nine countries in de^llDping and implementing new 
approaches to the direction of basic research yields four 
distinct models of priority setting and implementation: 
structural, thematic disconnected, thematic connected, 
and systematic. In the following section, these models are 
applied to the U.S. experience. 



Structural 

In the United Kingdom, Netherlands, Canada, and to a 
les.ser extent, Australia, the emphasis has been on the 
application of stmctural priorities. These have generally 
followed the principles of concentration, either by allocat- 
ing more of the resources in larger units, and/or by 
increasing the small proportion of research funds distrib- 
uted on a competitive basis. However, concentration 
alone carries the danger of freezing national capabilities 
around present or past historical strengths. Structural 
priority setting thus would not appear to be an appropriate 
mechanism, of its own, to identify and respond to 
challenges and opportunities of the future. 

The British system would appear to have a particular 
defect in the extent to which the basis for implementation 
of structural priorities and determination of thematic 
priorities occurs behind closed doors by an appointed and 
nonrepresentative elite. Such a nonparticipative approach 
would appear to have grave dangers of engendering 
hostility and resentment among researchers instead of 
building consensus required for effective priority setting 
and implementation. In contrast, in the Netherlands 
bibliomctric measures have been developed in an attempt 
to provide a public and objective basis for structural 
priorities together with an open and transparent system of 
evaluation.^ 



Thematic Disconnected 

This model is evident in the United Kingdom, Canada 
and Australia, and for some prognuns in Japan, It 
describes the system in which priority setting is effec- 
tively disconnected from the priority«implementation 
process. In each of these countries the establishment of 
priorities occurs in a relatively closed process, but the 
implementation is through traditional methods of an open 
call for competitive proposals, to be evaluated by peer 
panels together with ad hoc referee reports. Such a system 
has the virtues of combining thematic priority setting with 
researcher freedom to develop research programs subject 
to evaluation. There is a real danger, howev^, that the 
priorities would serve as little more than signposts for 
labeling of projects, and the level of implementation of 
the priorities could remain quite low. The deep resistance 
of Canadian and United Kingdom scientists to just such 
a system would appear to confirm the likelihood of this 
problem. 



Thematic Connected 

This model describes systems in which the priority- 
setiing and implementation mechanisms are tightly cou- 
pled. Within this model there are two different types. The 
Federal Republic of Germany represents a bottom-up 
form of the thematic connected model, in which the 
scientists themselves are primarily responsible for identi- 
fying thematic priorities, but once established, it is 
essentially the same researchers who are invited to 
prepare proposals according to negotiated criteria. 

The other type is the top-down thematic connected 
model, which operates in France, India, and less so in the 
CouncU for Planning and Coordination of Research 
(FRN) in Sweden. In these cases, the thematic priorities 
are identified by research agencies, composed variously 
of researchers, users, government officials, and commu- 
nity representatives. Then the research agency can work 
with select individuals and groups to develop proposals 
that meet the requirements as determined by the agency. 
For example, though modestly funded, the Swedish FRN 
provides a positive model of building basic research 
around societal needs, articulating research problems with 
relevant research disciplines and specialties. 

The top-down thematic connected model has consider- 
able advantages in terms of efficiency and effective 
implementation. However, it is more likely lo be accepta- 
ble in a nation where a culture of cooperation and 
planning is well established. In a more competitive 
culture this system could be seen as being too readily open 
to nepotism and political favoritism. 



^^For wainple. sec A.J. Ncderhof aiid A.FJ. van Kaan. ''An Intenialional Interview Round on Ihc Use and Development of Science and TeclmoIoKv 
Indicators, report lo the Nclhcrlands Ministry of Education and Sciences. Ducctorale-Geucral for Science Policy, June 1988. 
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Systematic 

This model is best represented in Sweden and France, 
and perhaps India. In Sweden, an extraordinarily inten- 
sive systematic process of consultation, information 
gathering, and preparation and review of position papers 
and symposia leads to the drafting of a 3-year research bill 
that sets the national directions in research. It represents 
a major exercise in consensus generation that might be far 
less successful in countries where consensus is not a 
strong national feature. 

Similarly in France, a major systematic effort is being 
directed to establishing a national capability in research 
intelligence, foresight, and evaluation. A wide range of 
foresight exercises^ have been attempted and two public 
sector think tanks-Hhe Centre de Prospective et d'Evalu- 
ation and the Observatoire des Sciences et Ibchniques — 
have been established to attempt to produce indicatcnrs, 
conduct evaluations, and create a national capacity in 
research evaluation. It remains to be seen whether the 
woric of these units will feed into decisionmaking. 

Applications for the United States 

As the research economy changes in the United States, 
the experience of other countries in coping with their 
research economies can be instructive. However, the 
institutional stnicmres of policymaking and funding are 
critical determinants of the way in which governments 
support basic research and provide a powerful sening to 
which any new methods of selection must be adapted. 
Hence any system operating in another country would 
need to be refashioned to fit another's political culture, 
structure, and decisionmaking practices. 

There are a number of features endemic to the U.S. 
research system to bear in mind when considering the 
applicability of the experiences of the nine countries 
surveyed. 

1. In each of the nine countries, the govemment pays 
for researcher salaries, support, equipment, and 
materials through general institutional grants, 
which are supplemented by competitive funds for 
research projects. In contrast, the primary funding 



mechanism for academic research in the United 
States is competitive support for specific leseaich 
projects. 

2. In the vast majority of the cases in the nine 
countries, individual researchers and research teams 
have only one possible source of funds to suppcnt 
their research beyond that available horn institu* 
ticMial grants. In the United Sutes, there has been a 
plurality of potential funding agencies for research* 
ers. 

3. In the United States, there is a very high level of 
absolute funding for basic research, comparable to 
that of Federal Republic of Germany (once defense 
research is excluded). In addition, aU nine countries 
have shifted almost all of their big science into 
international cooperative ventures. 

What, then, are the lessons for U.S. agencies? The 
strategies described above represent experimental alterna- 
tives for research decisimmaking. 

The structural priorities model describes the Depart- 
ment of Defense in the 1980s and presumably the 1990s, 
especially in reference to the consolidation of the defense 
laboratories. Both the thematic disconnected and the 
thematic connected models might be appropriate for 
consideration by the National Institutes of Health, the 
National Science Foundation, the Department of Energy, 
and the National Aeronautics and Space Administration. 
Indeed, components of these models ait already in place 
at these agencies. The thematic disconnected model is 
likely to be most appropriate when the identified thematic 
priority area is relevant to a range of well-established 
disciplines. Where a thematic priority is opening up a very 
new area, sitting at the boundaries of a number of 
disciplines, or demanding a large allocation of resources, 
the more directive thematic connected model might prove 
effective 

However, what is more important in the U.S. context is 
that the research agencies experiment and evaluate 
research pric^ties in a systematic and open way. At the 
same time, these models and research policymaking in 
other countries could be monitored for some possibly 
valuable lessons. 
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defined, 192 

graduate students, 212 

intramural labs, 120 

young scientists, 100 
Walgren, Don, 137 
War, 250 

Persian Gulf, 6, 250 

public perceptions during, 53 
Waste management, 52 
Weuiberg, Alvin, 139-140, 144, 145, 147 
White, Robert, 20-21 
Women, 10, 17,98, 129 

educational opportunities, 28, 29, 31-33,44,64,216-217, 222 

graduate enrollment, 210 

NSF, 113,270 

Ph.D.s, 206-207, 208. 209 

young researchers, 65 
World War II, 4 

Young scientists, 64, 65^66, 98. 195-1%, 197 
academic, 66, 219 
NIH, 128 
salaries, 100 

see also graduate education and research 



U.S. GOVERNMENT PRINTING OFFICE ; 1991 0 - 2y2-8B3 QL 3 

322 



other Related OTA Reports 



• Educating Scientists and Engineers: Grade School to Grad School. Presents 
American public education as "all one system'*; traces the formation of the student 
talent pool through the science and engineering pipeline into the research work force; 
discusses recruitment and retention as policy options for coping with demographic 
changes and market uncertainty. SET-377, 6/88; 136 p. 

NTIS order #PB 88-235 973/AS 

• The Regulatory Environment for Science (TM-SET-34) 

NTIS order #PB 86-182 003/AS 

• Research Funding As An Investment: Can We Measure the Returns? 
(TM.SET.36) 

NTIS order #PB 86-218 278/AS 

• Demographic Trends and the Scientiflc and Engineering Work Force 
(TM-SET.35) 

NTIS order #PB 86-206 182/AS 

• Holding the Edge: Maintaining the Defense Technology Base. Examines the 
management of DoD technology base programs and laboratories; analyzes the process 
through which technology is introduced into defense systems; and examines the 
exploitation of civilian commercial sector technology for defense needs. Concentrates 
on the dual questions of expediting military access to civilian technology and keeping 
the necessary base of technology alive and well in the United States. ISC-420, 4/89; 
200 p. 

Free summary available from OTA. 

GPO stock #052-003-01 150-6 $9.00 per copy 

NTIS order #PB 89-196 604/AS 

• Agricultural Research and Technology Transfer Policies for the 1990s: Special 
Report for 1990 Farm Bill 

As.sesses the changing agenda for American agriculture and the responsiveness of the 
agricultural research and technology transfer sy.stem to these changes. F-448, 3/90; 52 p. 

GPO stock #052-003-011 82-4 $2.50 per copy 

NTIS order #PB 90-219 981 



NOTE: Rc}X5ns are available from Uic U.S. Oovcmnieni Priming Office. Sujwrjnicndeiil of Documents. 
Wa.shingtoii. DC 20402-9325. (202) 783-3238; ancl/or iJjc National Tccfuucal Infomiation Service. 5285 
Port Roy id Road, SpringfMsld. VA 22161-0001, (703) 487-4650. 



3;>., 



Superintendent of Documents Publications Order Form 

Charge your order. 

Yli<i99 please send me the following indicated publications: I'o f*« yo""" »riers and liiqulrlci-(202) 275-0019 

cupies of Federally Funded Research: Decisions for a Decade 



OHv hoKiwig cut 

'i'6001 



(314 pages), S/N Or)2-003-01241-3 ai $12.00 each. 

copit's o{ Summary (32 pages), S/N 052-003-01232-4 ai S2.50 each. 



CU Please send me your Free Catalog of hundreds of besiselling Government books. 

The total cost of my order is $ (International customers please add 25%.) Prices include regular domestic postage and 

handling and are good through U/91 After this date, please call Order and Information Desk at 202-783-3238 to verify prices. 

Please Choose Method of Payment: 



(Company or pernonal name) 
(Additional addresh/attention line)" 



(Please type or print) 



C] Check payable to the Supc rincendent of Docume nts 
n GPO Deposit Account I I I I I I I h 'f~ ] 
[Z] VISA or MasterCard Account 



(Street address) 



(City, Slate. ZIP Code) 



(Credit card expiration date) 



Thank you for your order! 



(Daytime phone including area ciKte) 



(Signature) 



5/91 



Mall To: Superintendent of D(KumcrUs, Government Printing Office, Washington, DC 20402-9325 
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ERIC 




Office of Technology Assessment 



The Office of Technology Assessment (OTA) was created in 1972 as an 
analytical arm of Congress. OTA*s basic function is to help legislative policy- 
makers anticipate and plan for the consequences of technological changes and 
to examine the many ways» expected and unexpected, in which technology 
affects people*s lives. The assessment of technology calls for exploration of 
the physical, biological, economic, social, and political impacts that can result 
from applications of scientific knowledge. OTA provides Congress with in- 
dependent and timely information about the potential effects— both benefi- 
cial and harmful— of technological applications. 

Requests for studies are made by chairmen of standing committees of the 
Hou.se of Representatives or Senate; by the Technology Assessment Board, 
the governing body of OTA; or by the Director of OTA in consultation with 
the Board. 

l^he Technology As.sessment Board is composed of six members of the 
House, six members of the Senate, and the OTA Director, who is a non- 
voting member. 

OTA has studies under way in nine program areas: energy and materi- 
als; industry, technology, and employment; international security and com- 
merce; biological applications; food and renewable resources; health; 
telecommunication and computing technologies; oceans and environment; 
and science, education, and transportation. 
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